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(54) Terminal apparatus and method for achieving interactive operations 



(57) A terminal apparatus is provided for displaying 
an image by reproducing a piece of image information 
and for interactively changing the image using naviga- 
tion information. The image is a moving picture, a still 
picture, or a mixture of them. The image information and 
the navigation information together are broadcast by a 
broadcasting station to the terminal apparatus. The nav- 
igation information indicates a plurality pieces of link- 
target image information. The cache unit stores a pair 
of image information and navigation information. The re- 
producing unit reproduces the image information. The 
monitoring unit monitors whether an operator has per- 
formed a certain operation responding to the image dis- 
played. The receiving unit, before the operator performs 
the certain operation, receives a plurality pieces of im- 



age inlormation which have possibility of being dis- 
played and a plurality pieces of correspondinq naviqa- 
tion information based on the navigation information, 
and stores the plurality pieces of image information and 
navigation information in the cache unit. The specifying 
unit specifies a piece of link-target image information 
based on the certain operation. The identifying unit iden- 
tifies the piece ol link-target image information as a 
piece of image information. The first controlling unit 
reads the piece of link-target image information and in- 
structs the reproducing unit to reproduce the piece of 
link-target image information, and instructs the receiving 
unit to receive other plurality pieces of image information 
and navigation information based on a piece of naviga- 
tion information corresponding to the link-target image 
information identified by the identifying uniL 
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Description 

BACKGROUND OF THE INVENTION 

(1) Field of the Invention * 

This invention relates to a terminal apparatus used 
in communication services such as digital satellite 
broadcasting and digital CATV (Community Antenna 
Television), and to a method used for the terminal ap- 1 
paratus. 

(2) Description ol the Prior Art 

As the number of channels provided in the satellite 
broadcasting or CATV has increased greatly, competi- 
tion among broadcasting companies has been intensi- 
fied. Broadcasting companies hope that broadcasting 
systems known as interactive TV broadcasting systems 
will attract many viewers, and active studies into inter* 
aclive TV broadcasting systems are under way. The 
term "interactive* indicates that the user can display de- 
sired images by making requests. Suppose, for exam- 
ple, each screen includes a plurality of icons which are 
related to other pieces of image information which form 
screens. It is supposed that in the interactive TV broad- 
casting system, a desired piece of image information is 
displayed when the operator selects an icon on the in- 
teractive screen. The operator feels as if he/she could 
display what he/she desired. Such an interactive TV 
broadcasting system is epoch-making in TV broadcast- 
ing whore one-way broadcasting has long been the 
norm. There is a possibility that the interactive TV broad- 
casting system will become a next-generation standard 
for TV broadcasting system. 

Such an interactive TV broadcasting system may 
be achieved by a method in which each terminal appa- 
ratus sends a request for transmitting a desired piece of 
imago information to the broadcasting station, and in re- 
sponse, the broadcasting station transmits the desired 
piece of image information to the terminal apparatuse. 
For achieving this, the broadcasting station needs to 
store a large amount of image information which can be 
provided to the terminal apparatuses. 

It is increastngr/ difficult to achieve the above sys- 
tem as the number of terminal apparatuses increases. 
This is because a number of communication lines need 
to be provided for transferring the transmission requests 
and image information. Such a construction may also 
surfer from an overflow in handling the transmission re- 
quests in the broadcasting station due to an overflow in 
the communication lines which are used for transferring 
the read requests and image information. Viewers may 
step using such an interactive TV broadcasting system 
if it takes very long to display a desired image. 



SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to 
provide a terminal apparatus and a method used therein 
s for immediately displaying a desired piece of image in- 
formation in an interactive broadcasting system upon re- 
quest of the operator, where a large number of terminal 
apparatuses receive broadcasts in the interactive 
broadcasting system, 
to Ths above object is achieved by a terminal appara- 
tus for displaying an image by reproducing one out of m 
pieces of image information and for interactively chang- 
ing the image using n pieces of navigation information, 
where the image is one of a moving picture, a still pic- 
is ture, and a mixture of a moving picture and a still picture, 
where the m pieces of image information and the n piec- 
es cf navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, where 
each piece of navigation information is related to an or- 
20 igin piece ol image information and indicates a plurality 
pieces ol link-target image information, where m and n 
are each an integer either ol being equal to and larger 
than "1," the terminal apparatus including: a cache unit 
Icr storing a pair of one out ol the m pieces ol image 
2S information and one out of the n pieces of navigation 
inlormation; reproducing unit lor reproducing the one 
out of the m pieces of image information stored in the 
cache unit; monitoring unit for monitoring whether an op- 
erator has performed a certain operation responding to 
jo the image displayed; a receiving unit for. before the 
monitoring unit determines that the operator has per- 
tormed the certain operation, receiving s pieces of im- 
age inlormation which have possibility of being dis- 
played and t pieces of navigation information respec- 
35 tively related to the s pieces of image information based 
on the one out of the n pieces of navigation information 
stored in the cache unit, and storing the s pieces of im- 
age information and the t pieces of navigation informa- 
tion in the cache unit, where s is an integer satisfying 
■so 1 -ss<m, and t is an integer satisfying 1 £t<n; a specify- 
ing unit for specifying one out of the plurality pieces of 
link-target image information based on the certain oper- 
ation when the monitoring unit monitors that the opera- 
tor has performed the certain operation; an identifying 
as unit for identifying the one out ol the plurality pieces of 
link-target image information specified by the specifying 
unit as one out the s pieces of image information stored 
in the cache unit; and a first controlling unit for reading 
the piece of link-target image information identified by 
so the identifying unit and instructing the reproducing unit 
to reproduce the piece of link-target image information, 
and instructing the receiving unit to receive other s piec- 
es of image information and other t pieces of navigation 
information based on one out of the t pieces of naviga- 
ss Won information in the cache unit corresponding to the 
piece of link-target image information identified by the 

identifying unit. 

With such a construction, a desired piece of image 
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information is immediately displayed. The current 
screen is changed to the next screen at high speed upon 
request of the operator since while the current screen is 
displayed, a plurality pieces of link-target image infor- 
mation and corresponding pieces of navigation informa- 
tion are stored in the cache unit. The above screen 
change is also performed using the waiting time of the 
terminal apparatus for a period during which the opera- 
tor determines an icon on the screen. 

The above terminal apparatus may further include: 
a superimposing unit lor superimposing, based on a 
piece ol navigation information corresponding to the one 
out of the m pieces of image information stored in the 
cache unit, a plurality of icons on the image which is 
displayed when the reproducing unit reproduces the one 
out of the m pieces of image information, where the 
monitoring unit includes: a determination operation de- 
tecting unit for detecting a determination operation per- 
formed on one out of the plurality of icons, where the 
idenlilying unit identifies one out of the plurality pieces 
of link-target image information detected by the deter- 
mination operation delecting unit. 

With such a construction, a visual interactive oper- 
ation is achieved since a plurality of icons, which indi- 
cate link-target pieces ol image information, are super- 
imposed on the screen image. 

In the above terminal apparatus, the reproducing 
unit may include, a focus selling unit lor making one oul 
of the plurality of icons be in focus, where the monitoring 
unit includes: a cursor move operation delecting unit lor 
delecting a cursor move operation; and a focus chang- 
ing unit for making another one out of the plurality ol 
icons bo in focus based on the cursor move operation 
detected by the cursor move operation detecting unit, 
where the determination operation detecting unit de- 
tects a determination operation performed on the other 
one out ol ihe plurality ol icons in focus. 

With such a construction, the cursor (icon in focus) 
is moved based on the interactive operation. This ena- 
bles cursor moves with the use of cross keys. 

The.above terminal apparatus may further include: 
a rank setting unit for setting ranks of the m pieces of 
image information stored in the cache unit based on 
possibility of being displayed; and a cache table regis- 
tering unit for registering identifiers of high ranking s 
pieces of image information in a cache table, out ol the 
m pieces of image information and registering identifiers 
of t pieces of navigation information corresponding to 
the high ranking s pieces of image information, where 
the receiving unit receives the s pieces of image infor- 
mation whose identifiers are registered by the cache ta- 
ble registering unit and receives t pieces of navigation 
information corresponding to the s pieces of image in- 
formation. 

With such a construction, a certain number of piec- 
es of image information having possibility of being dis- 
played are stored in the cache unit. Therefore, these 
pieces of image information and corresponding naviga- 



tion information are displayed with high probability. 

The above terminal apparatus may further include: 
a weighting unit for weighting, with a highest value, the 
one out of the plurality of icons made to be in focus by 
5 the focus setting unit, and for weighting, with a second 
highest value, icons adjacent to the one in focus, where 
the rank setting unit sets ranks ol the m pieces of Image 
information based on values weighted by the weighting 
unit. 

to With such a construction, information related to the 
icon in focus and the adjacent icons is stored in the 
cache unit. Therefore, these pieces of image informa- 
tion and corresponding navigation information are dis- 
played with high probability. 
is The above terminal apparatus may further include: 
a statistics value storing unit lor storing a statistics value 
lor each piece of image information which indicates a 
number of times the piece of image information has 
been determined, where the rank setting unit sets ranks 
20 of the m pieces ol image information based on the sta- 
tistics value for each piece of image information. 

Wilh such a construction, the possibility of being 
displayed is evaluated based on the statistics values. 
Therefore, these pieces ol image inlormation and cor- 
25 responding navigation information are displayed with 
high probability. 

The above terminal apparatus may further include: 
a rank information detecting unit for detecting a piece of 
rank information from the piece of navigation informa- 
30 tion corresponding to the one out of the m pieces of im- 
age inlormation reproduced by the reproducing unit, 
where the piece of rank information includes ranks of 
the plurality pieces of link-target image inlormation. 
where the rank setting unit sets ranks of the m pieces 
J5 ol image information based on the piece of rank infor- 
mation. 

Wilh such a construction, the possibility of being 
displayed is evaluated based on the rank included in 
each piece of navigation information. Therefore, these 
aq pieces of image information and corresponding naviga- 
tion information are displayed with high probability. 

BRIEF DESCRIPTION OF THE DRAWINGS 

4S These and other objects, advantages and features 
of the invention will become apparent from the following 
description thereof taken in conjunction with the accom- 
panying drawings which illustrate a specific embodi- 
ment of the invention. In the drawings: 

so 

F1G.1 A shows a pictorial view of a satellite broad- 
casting system; 

FIG.1B shows the construction of the transport 
stream which is divided into a number of transport 

55 packets: 

FIG.2A shows the first frame of video element(1] 
and a corresponding voice in audio element! 1 \, both 
'included in presentation stream(1]; 



3 



\ 



EP 0 827 340 A2 



F1G.2B shows the first frame of video elamenl(2] 
and a corresponding voice in audio element[2], both 
included in presentation stream[2]; 
F1G.2C shows the first frame of video element! 12) 
and a corresponding voice in audio element(l2], 
both included in presentation stream[12]; 
FIG. 2D shows the first frame of video elament[43] 
and a corresponding voice in audio element[43], 

both included in presentation stream[43]; 

FIG.3 shows the content of NVT[1]; 

FIG.4 shows the content of NVT12]; 

FIG.5 shows the content of NVT[12); 

FIG.6 shows the content of PMT; 

FIG.7 shows a tree structure formed with NVTs and 

•contents;* 

F1G.BA shows an appearance of the viewing system 
for satellite broadcasting; 

FIG.8B shows the Iron! panel of handy remote con- 
troller 4; 

FIG.9 shows the construction of terminal apparatus 
2; 

FIGs.10A-10G show contents of navigation cache 
unit 14; 

FIGs. 1 1 A-1 1 G show contents ol presentation cache 
unit 15; 

FIG. 12 shows a statistics table stored in statistics 
table storing unit 18; 

FIG.13A shows a cache table which is generated 
based on the statistics table; 
FIG. 1 38 shows a cache table which is generated 
based on the "rank" column in the hyperlink table; 
FIG.13C shows a cache table which is generated 
based on the icon currently in focus; 
FIG. 14 shows the main flowchart of the operation 
of cache manager 17; 

FIG. 15 shows the flowchart of cache manager 17 
in reading contents in advance; 
FIG. 16 shows the flowchart of cache manager 17 
in generating the cache table; 
FIG 17 shows the flowchart of cache manager 17 
in reading contents in advance: 
FIG. 13 shows the main flowchart of the operation 
of browser 25; 

FIG. 19 the flowchart of browser 25 in switching in- 
teractive screens; 

FIG. 20 the flowchart of browser 25 in switching in- 
teractive scraans; 

F1G.21 the flowchart of browser 25 in switching in- 
teractive screens; 

FIG.22A shows an interactive screen which is an 
image generated from presentation streamp] with 
the icons of NVT[l] superimposed on the image; 
FIG.22B shows an interactive screen which is an 
image generated from presentation streamI2] with 
the icons of NVT[2J superimposed on the image; 
FIG.22C shows an interactive screen which is an 
image generated from presentation stream[1 2] with 
the icons of NVT[121 superimposed on the image; 
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FIG. 220 shows an interactive screen which is an 
image generated from presentation stream] 43] with 
the icons of NVT[43] superimposed on the image; 
FIG. 23 shows the contents of the transport streams 
including still pictures; 
FIG.24A shows the content of VETJ 1 5); 
FIG.243 shows the content of VETJ16]; and 
FIG.25 shows a content of the hyperlink table. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 



<First Embodiment 

75 To achieve an interactive TV broadcasting system 
connected to a large number ol terminal apparatuses 
set in a number of households, it is not ideal to allow the 
terminal apparatuses to send requests for transmitting 
images. The present embodiment achieves an interac- 
20 tive TV broadcasting system in which requests for trans- 
mitting images are not sent from the terminal appara- 
tuses. In the present embodiment, a TV broadcasting 
station sends a plurality ol images to a plurality of ter- 
minal apparatuses so that the terminal apparatuses 
2S each can interactively select and receive a desired im- 
age. 

In such a broadcasting system, the interactivity is 
achieved by one-way image transmission since it is not 
necessary for the terminal apparatuses to send image 
30 transmission requests to the TV broadcasting station. 
On the other hand, the TV broadcasting station is re- 
quired to send quite a large number of images to the 
terminal apparatuses since it must send all the neces- 
sary images lor achieving the interactivity. When this 
35 happens, that is. when the number of sent images in- 
creases, the time taken to receive and display the im- 
ages also increases. 

FIG.1 A shows a pictorial view of a satellite broad- 
casting system described in the present embodiment. 
£0 As shown in this drawing, broadcasting station 100 
transmits a broadcasting wave to broadcasting satellite 
200, as indicated by dotted line hi . Broadcasting satel- 
lite 200 sends this broadcasting wave to a wide region 
on the earth, as indicated by dotted lines h2, h3, h4. and 
« h5. so that terminal apparatuses in this region receive 
the broadcasting wave. Broadcasting station 100 and 
broadcasting satellite 200 repeat such transmissions In 
a unit cycle of several minutes. This enables a targe 
number of terminal apparatuses in the region to receive 
so the broadcasting wave. 

The broadcasting wave mentioned above Is a car- 
rier wave which has been modulated from transport 
streams with the QPSK (Quadrature Phase Shift Key- 
ing) method. 

55 Each of the transport streams is composed of vari- 
ous types of data, or multiple data. The transport stream 
is defined in detail in MPEG (Motion Picture Experts 
Group). A transport stream is composed of a large 
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number ol transport packets. The transport packet is 
used lor transmitting data and is the smallest unit of data 
whose transmission is assured. Each transport packet 
includes an error detection code and an error correction 
code. 

FIGilB shows the construction ol the transport 
stream. The transport stream is represented by a hori- 
zontally-long rectangle in the upper part ol the drawing, 
the transport stream being divided into a number ol box- 
es representing transport packets. 

The lower part ol FIG.1 B shows a plurality of sub- 
streams ol the transport stream. The sub-streams are: 
a video elementary stream which is composed of video 
elements (represented each as " VE" in the drawing), an 
video elementary stream which is composed of audio 
elements (represented each as "AE" in the drawing), a 
navigation information table (NVT) sub-stream which is 
composed of NVTs (represented each as *NVT* in the 
drawing), a program clock relerence (PCR) table sub- 
stream (represented each as "PCR* in the drawing) lor 
synchronizing the video elements with the audio ele- 
ments, a program association table (PAT) sub-stream 
which is composed of PATs (represented each as "PAP 
in the drawing), a program map table (PMT) sub-stream 
which is composed ol PMTs (represented each as 
*PMT" in the drawing), a network inlormalion table (NIT) 
sub-slream which is composed of NITs (represented 
each as "NIT" in the drawing) lor indicating which satel- 
lite is used to relay the transport packets, that is. for in- 
dicating to which network the transport packets belong. 
. a service description table sub-stream (represented as 
"SDT" in the drawing) lor indicating v/hich program is 
broadcast by the transport packets, that is. for indicating 
to v/hich service the transport packets belong, and an 
event inlormalion table (EIT) sub-stream which is com- 
posed of ElTs (represented each as "EIT" In the draw- 
ing) for indicating to v/hich channel, namely to which 
event, the transport packets belong. For more informa- 
tion on the above sub-streams, reler to ETS 300 463 
standard (DVB-SI standard) and ISO/1EC 13518-1 
(MPEG2 system standard). 

As described above, transport streams, each in- 
cluding various types ol data as shown in FIG.1 B, are 
transmitted. 

Each transport packet, which belongs to a video el- 
ement or an audio element, includes a packet identifier 
(PID) which indicates to which element.the transport 
packet belongs. 

A plurality of video elements, audio elements, and 
PCRs make up a presentation stream v/hich corre- 
sponds to one scene in a film. 

VE(1], VE (2], VE[12] : VE[43] ... in FIG.1B include 
their own PIDs. For example. VE(1] includes PID 
"0x202;" VEf2] includes PID •0x302." 

FIGS.2A-2D show examples of audio elements and 
video elements making up a presentation stream. 

Presentation stream[1] includes audio elementll) 
with PID '0x60 1 " and video element! 1 ) with PID "0x202." 



FIG.2A shows a scene which is obtained by decoding 
video etement[l]. In this scene, an announcer of a 
broadcasting company makes an introductory speech 
lor about two-minules. The video element[1 ) is accom- 
5 panied by audio element[ 1 ] which includes a narration: 
■INTRODUCING INTERACTIVE CHANNEL. THANK 
YOU FOR SELECTING THE 'A* BROADCAST. FOR 
TODAY'S BROADCAST. WE WILL BE SHOWING THE 
FOLLOWING PROGRAMS. WE ARE SURE YOU WILL 

io ENJOY THEM." 

Presentation stream[2) includes audio element^) 
with PID "0x602" and video element[2J v/ith PID "0x302." 
FIG.2B shows a scene which is displayed by decoding 
video element[2]. The scene provides a preview of films 
is to be released soon. The video elemental Is accompa- 
nied by audio element^) which includes a narration: 
•NEW MOVIE INFORMATION. COMING UP SOON AT 
THEATERS IN OSAKA.' 

FlGs.2C and 2D respectively show the content of 
20 presentation streams[12] and 143]. Presentation 
streams[1 2) and [43) respectively include the shots and 
narrations shown in the drawings. 

The "NVT" is important as a private section under 
ISO/lEC 13818-1 standard. Each private section can 
2$ additionally include a "table_id_extension" which is 
called a table identities Each ol NVTs[0|, [1), [2J. and 
[1 21 shown in FIG.l B, lor example, includes a common 
P10. "0x0052." NVT [0| also includes table identifier 
"0x0000." NVTlil includes table identifier "0x0001," 
30 NVT(2J table identifier "0x0002 J and NVT[12] table 
identilier "0x0012." That means, a video element or an 
audio element identities itsell with a PID; an NVT iden- 
tifies itself with a table identifier. 

Now. the navigation information table (NVT) is de- 

3$ scribed. 

The NVT includes navigation information which is 
used tor displaying icons on the screen and moving the 
icons based on interactive operations made with the op- 
erator. The icons in the present embodiment are any of 
■io patterns, characters, and colors, or combinations of 
these elements. The icons are used to inform the oper- 
ator of the content of information, and is used as option 
items. A representative method of indicating a selected 
icon is a cursor display. The cursor display described 
4S here Is a different color of one icon than the other icons 
displayed on the screen. This is an eflective way for 
drawing the attention ol the operator to the icon. The 
icon with the different color is also called an icon in fo- 
cus. That means, as the cursor moves, the color of the 
so icon also changes. 

Now. the data structure of the NVT is described with 

reference to FIGs.3. 4, and 5. 

FIG.3 shows the content of NVTpl shown in FIG. 
IB. FIG.4 shows the content of NVTt2] shown in FIG. 
55 1 B. FIG.5 shows the content of NVT[1 2] shown in FIG. 
1B. Each NVT is composed of bit map table 301, object 
definition table 302. handler definition table 303. and hy- 
perlink table 304. Each piece of information in each table 
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is related to each other. For example, a piece ol infor- 
mation with index number 1 in the object definition table 
302 is related to a piece of information with HDJndex 
number 1 in the handler definition table 303 as Indicated 
by the HANDLER column, and further to a piece of in- 
formation with HLJndex number 1 in the hyperlink table 
304 as indicated by the 'script' column. Such pieces ol 
information in the NVT related to each other make up a 
piece of navigation information. 

Bitmap table 301 of NVT(1] shown in FIG.3 is com- 
posed of bitmap 1 used as an icon indicating "NEW 
MOVIE INFORMATION," bitmap 2 as an icon indicating 
■INTERNET LATEST INFORMATION.' bitmap 3 as an 
icon indicating "EVENT INFORMATION," bitmap 4 as 
an icon indicating 'PROGRAM PREVIEW," and bitmaps 
101-104 which are copies of bitmaps 1 -4 and are high- 
lighted. 

The bit map table ol NVT12J shown in FIG.4 is com- 
posed ol bitmap 5 used as an icon indicating "THE TER- 
ROR OF THE HUGE TORNADO (DISTRIBUTED BY 
AAA COMPANY)," "THE RETURN OF THE MON- 
STROUS DINOSAURS (DISTRIBUTED BY BBS COM- 
PANY)." "SPORTS WARS (DISTRIBUTED BY AAA 
COMPANY)," and "RETURN," and bitmaps 105-108 
which are copies ol bitmaps 5-8 and are highlighted. 

While each ol the bitmap tables of NVT[1 J and NVT 
12) includes four pieces ol bitmap information, some bit- 
map tables include as many as 10 pieces of bitmap in- 
formation. NVT[ 121 shown in FIG. 5 provides an example 
of such a bitmap table. 

Object definition table 302 is composed of a plurality 
pieces of object definition information which is used to 
define the icons included in the same NVT as objects. 
The object definition table 302 includes columns called 
"index." "type." "X-coordinate." "Y-coordinate," "HAN- 
DLER.* "normal bitmap,' and "locuscd_bitmap." 

The "index* column shows the index number of 
each piece of information included in the table. 

The "type" column shows the object type. For ex- 
ample each'picce of information in the object definition 
table is specified as 'Button" in the type column, which 
indicates that the icon has a characteristic as a button. 

The values in the 'X-coordinate" and *Y-coordinale' 
columns show the respective X and Y coordinates of the 
standard display position on the display screen. For ex- 
ample, X and Y coordinates of navigation informational 
are respectively x1=50 and y1=50; X and Y coordinates 
of navigation informational are respectively x2=100 
and y2=50. The origin of the coordinate system is in the 
upper-left corner. Bitmap 1 representing the 'NEW 
MOVIE INFORMATION" icon is displayed at a position 
specified by xl =50 and y1 =50, an upper-left position on 
the screen. Bitmap 2 representing the 'INTERNET LAT- 
EST INFORMATION" icon is displayed at a position 
specified by x2=100 and y2=S0 5 an upper-right position 

on the screen. 

The "HANDLER" column points out an HDJndex 
number in the handler definition table 303. The intorma- 



tion with the HD index number includes a script as 
shown in the 'script' column which shows a link-target 
•content' by the HL index number In the hyperlink table 
304. where a 'content' is composed of a NVT. a video 
5 element, and an audio element. 

. The 'normal_bitmap' column shows bit maps 
amcng those included in the bit map table which are dis- 
played normally on the screen. 

The 'focus edjaitmap" column shov/s bit maps 
io amcng those included in the bit map table which are dis- 
played highlighted on the screen. 

The handler definition table 303 includes columns 
called "HDJndex" and 'script.' 

The 'HDJndex" column shows the HDJndex 
15 number of each piece of information included in the ta- 
. ble. 

The "script" column shows a script included in each 
piece of information included in the table. Every piece 
of inlormalion the handler definition table 303 shown in 
zo FIG.3 includes "goto_conlenf statement. The 
"goto_content* statement instructs the terminal appara- 
tus to fetch a piece of hyperlink information specified in 
the statement from the hyperlink table 304 and to obtain 
an NVT, video element, and audio element according to 
25 the hyperlink information. 

The hyperlink table 304 includes a column called 
*HL index" and 11 columns which are information ele- 
ments used to identify the link-target content. This is be- 
cause detailed inlormalion is required to specify a link 
30 target content among the vast amount of information 
provided in the digital broadcasting system. 

The "HLJndex" column shows the HLJndex 
number of each piece of information included in the ta- 
ble. 

35 The "orig_nw_id" column shows which satellite is 
used to relay the link-target NVT, video element, and au- 
dio element. In other words, the "orig_nwJd" column 
shows to which network the link-target NVT, video ele- 
ment, and audio element belong. 
40 The 'tsjd* column shows which transport stream 
is used to transfer the link-target content. 

The *VE_svcJd' column shows to which TV pro- 
gram (service) the link-target video element belongs 
among a plurality of TV programs included in the trans- 

£5 port stream. 

Th Q 'VE_event Jd" column shov/s to which broad- 
casting channel (event) the TVprogram of the link-target 
video element belongs. 

The 'VE_compjag* column shows which compo- 
se nent tag is attached to the link-target video element, 
where the component is a stream identified by a PID 
(packet identifier) as defined in the MP EG 2 standard. In 
the present embodiment, a video element or an audio 
element may be a component since each of these ele- 
ss ment includes its own PID. In case a group of video el- 
ements or audio elements are assigned one PID, the 
group is regarded as one component. 

Th9 'AE_svcJd' column shov/s to which TV pro- 
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gram (service)* the link-target audio element belongs 
among a plurality. of TV programs included in the trans- 
port packet 

The "AE^evenUd" column shows to which broad- 
casting channel (event) the TV program including of the s 
link-target audio element belongs. 

The ■AE_comp_tag* column shows which compo- 
nent tag is attached to the link-target audio element 

The "NE_svcJd - column shows to which TV pro- 
gram (service) the link-target NVT belongs among a plu- '<> 
rality ot TV programs included in the transport stream. 

The *NE_event Jd* column shows to which broad- 
casting channel (event) the TV program ot the link-target 
NVT belongs. 

The 'NEjd.EXT' column shows which table iden- * 5 
tilier ("tableJd_extension") is attached to the link-target 
NVT. 

The "rank" column shows a rank of the link-target 
video element, audio element, and NVT. the rank being 
determined by the broadcasting station according to the 20 
frequency of display or the like. In FIG.3, for example, 
a piece of information in the hyperlink table 304 with 
HLjndex number 1 (hereinafter, represented as 
HL_indexl1]) has the highest rank. '2,* followed by 
HLJndex(2]. HLjndex 13). and HLjndex [4]. The rank « 
may be determined according to answers to question- 
naires distributed by the broadcasting company, or ac- 
cording to fashions or topics in recent years. 

FIG.6 shows the content of the PMT (Program Map 
Table). The PMT includes columns called "PID," *o 
•streamjype," and "descriptor.* 

The "PID" column shows PIDs (Packel IDenlifiers). 

The 'streamjype" column shows a type of each 
stream. 

The "descriptor" column shows a stream descriptor 
•streamJdentifier_descriptor" including a component 
tag corresponding to each PID. For example, stream de- 
scriptor 'stream Jdentilier_descriptor including compo- 
nent tag "0x0002' is related to "PIO0x0302/ Stream de- 
scriptor "stream identifier_descriptor* including compo- 
nent tag '0x0003* is related to *PIOOx0303/ The PMT 
is required for the terminal apparatus to oblain a PID ot 
a transport packet from a component tag of a link-target 
video element or a link-target audio element obtained 
from the hyperlink table. 45 

A link-target NVT. video element, or audio element 
is obtained as follows based on the hyperlink table in 
NVT and PMT 



< Specifying Link-Target NVT> 

The'HANDLER" column of the object definition ta- 
ble 302 in NVT specifies one HOJndex number of the 
handler definition table 303. By referring to the script for 
the obtained HD index number, one HLjndex number 
of the hyperlink table 304 is obtained. By referring to the 
■NEJd.EXTT column of the table 304, the table identi- 
fier attached to the link-target NVT is obtained. 



so 



ss 



1-1 When bitmapl of NVT[1] related to the icon in- 
dicating 'NEW MOVIE INFORMATION' is deter- 
mined: 

HLjndex T -+ NEJd_EXT[0x0002] -» NVT 
(2] including table identifier "0x0002* (refer to FIG. 
1B for NVT(2) with the table identifier) 
1 -2 When bitmap2 of NVT{1 ] related to the Icon in- 
dicating 'INTERNET LATEST INFORMATION" is 
determined; 

HLjndex '2' NEJd_EXT[0x0003] -> NVT 
[3) including table identifier "0x0003* (refer to FIG. 
IB) 

1-3 When bitmaps of NVT(1] related to the icon in- 
dicating 'EVENT INFORMATION" is determined: 

HLjndex '3* -> NE Jd_E XT[0x0004] -* NVT 
[4] including table identifier '0x0004" (refer to FIG. 

1B) 

1-4 When bitmap4 of NVTI1] related to the icon in- 
dicating 'PROGRAM PREVIEW" is determined:. 

HLjndex "4* -+ N E Jd_E XT[0x0005 J -* NVT 
(5) including table identifier "0x0005" (refer to FIG. 
1B) 

specifying Link-Target Video Element> 

The"HANOLER" column of the object definition ta- 
ble 302 in NVT specifies one HDJndex number of the 
handler definition table 303. By referring to the script lor 
the obtained HD index number, one HLjndex number 
ol the hyperlink table 304 is obtained. By referring to the 
•VE_comp Jag" column ol the table 304, the component 
tag attached lo the link-target video element is obtained. 
By referring to the "descriptor" column of the PMT, the 
PID attached to the link-target video element is ob- 
tained. 

2-1 When bitmapl of NVT[1] related to the icon in- 
dicating *NEW MOVIE INFORMATION* is deter- 
mined: 

HLjndex T -» VE_compJag[0x0002J -> 
PID[0x0302] -* VE[2] (refer to FIG.1B) 
2-2 When bitmap2 of NVT[1 ] related to the icon in- 
dicating 'INTERNET LATEST INFORMATION* is 

determined: 

HLjndex m 2 m -» VE_compJag[0x0003] -> 
FlD[0x0303] -> VE[3] (refer to FIG.1 B) 
2-3 When bitmap3 of NVT[1 ] related to the icon in- 
dicating 'EVENT INFORMATION* is determined: 

HLJndex3 -+ VE_compjagl0x0004] -> PID 
[0x0304] -> VE[4] (refer to FIG.1 B) 
2-4 When bitmap4 of NVT[1] related to the icon in- 
dicating 'PROGRAM PREVIEW' is determined: 

HL_index4 -> VE_compjag[0x0005] PID 
(0x0305] -> VE(5] (refer to FIG.1 B) 

cSpecifying Link-Target Audio Element> 

Tne'H ANDLER' column of the object definition ta- 
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bla 302 In NVT specifies one HDJndex number of Ihe 
handler definition table 303. By relerring to the script for 
the obtained HD index number, one HLJndex number 
of the hyperlink table 304 is obtained. By referring to the 
*AE_comp_tag' column of the table 304. the component 
tag attached to the link-target audio element is obtained. 
By referring to the "descriptor* column of the PMTT, the 
PID attached to the link-target audio element is ob- 
tained. 

2-1 When bitmap 1 of NVTpl related to the icon in- 
dicating "NEW MOVIE INFORMATION* is deter- 
mined: 

HLJndex M* — > AE_comp_tag[0x0l02] -> 
PID[0x0602l -> AE(2] (refer to FIG. 1B) 
2-2 When bitmap2 of N VT[1 J related to the icon in- 
dicating "INTERNET LATEST INFORMATION* is 

determined: 

HLJndex "2' AE_compJag[0x0103J -> 

PlD[0x0603] AEI3] (refer to FIG.1 B) 
2-3 When bitmap3 of NVT[1) related to the icon in- 
dicating "EVENT INFORMATION" is determined: 

HLJndex3 -> AE_comp_tag[0x0104] PID 
10x0504] -> AE[4J (refer lo FlG.lB) 
2-4 When bitmap4 of N VT(1 1 related lo Ihe icon in- 
dicating "PROGRAM PREVIEW" is determined: 

HLJndex4 -» AE_comp_tagl0x0105] PID 
10x0505] -+ AE[5) (refer to FlG.lB) 



As will be understood from the above description. 
NVTI1] specifies NVT[2]. VE12]. and AE[2] as the link- 
targets. Such a group of a NVT, a video element, and 
an audio element specified as link-targets are called a 
"content." A link-target content is specified by an NVT. 
Then, another link-target is specified by the NVT of the 
content. In this way. NVT-conicnt relation is constructed. 

FIG. 7 shows a tree structure formed with NVTs and 
"contents" in the present embodiment. The plurality of ar- 
rows shown in the drawing indicate the direction of the 
links. Note that the root of the tree is called "root content.* 
FIG.7Jndicates that content[l] includes VE[1], AE 
[11, and NVT[1] (in the drawing. VE[i] and AE[1] is rep- 
resented as -VE_AE[1] * Hereinafter, a combination of 
VE and AE included in a content is represented as 
"VE_AE"). This indicates thai when presentation stream 
[1 ] is decoded to generate a shot image, the bit maps of 
NVT[1 1 are superimposed on the shot image. 

Similarly, contenl[2] includes VE[2l, AE[2], and NVT 
[2]. This indicates that when presentation stream[2] is 
decoded to generate an image of the preview of films, 
the bit maps of NVT12) are superimposed on the image. 

A screen which is composed of an image generated 
from a presentation stream with icons superimposed on 
the image is called an interactive screen. FIGs.22A-22D 
show interactive screens. FIG 22A. for example, shows 
an interactive screen which is an image generated from 
presentation streamp] with the icons of NVT(1] super- 
imposed on the image. 



The transport stream constructed as shown above 
is repeatedly transmitted from broadcasting station 100 
to the terminal apparatuses, as shown in FIG.1A. Ac- 
cordingly, the terminal apparatuses can obtain neces- 
s sary streams or tables. Note that the terminal appara- 
tuses must wait for each cycle period of the transmission 
tor obtaining the necessary streams or tables. 

Now. a system for viewing programs which are 
broadcast with transport streams is described. FIG.8A 
io shows an appearance of the viewing system which is 
composed of parabolic antenna 1. terminal apparatus 
2, TV receiver 3, and handy remote controller 4. 

Parabolic antenna 1 which is set outside a house is 
used to receive carrier waves of the transport streams 
is transmitted by the broadcasting satellite. 

Terminal apparatus 2 fetches transport streams 
from the carrier waves received by parabolic antenna 1 , 
and decodes the transport streams to NTSC or PAL im- 
age signals and stereo audio signals (hereinafter, a 
20 combination ol an image signal and an audio signal is 
called an AV signal). 

TV receiver 3 outputs images and voices according 
lo the AV signals decoded by terminal apparatus 2. 
Handy remote controller 4, while TV receiver 3 out- 
2S puts images and voices, receives instructions from the 
operator and outputs infrared ray signals representing 
the received instructions to terminal apparatus 2. 

FIG.5B shows the keys arranged on handy remote 
controller 4. Handy remote controller 4 includes cross 
30 key 41 tor moving the cursor, ten keys 42 for specifying 
numerals lor selection, and enter key 43 for determining 

icons and the like. 

The construction of the terminal apparatus is de- 
scribed with reference to FIG.9. The terminal apparatus 
3$ is composed of demodulator 1 0 ; TS decoder 11, AV de- 
coder 12. AV decoder controlling unit 13, navigation 
cache unit 1 4. presentation cache unit 1 5, operation de- 
tecting unit 16, cache manager 17. statistics table stor- 
ing unit 18. mode managing unit 19. cache table storing 
-'0 unit 20. cache processing unit 21, input switching unit 
22. graphic storing unit 23. graphic displaying unit 24. 
and browser 25. 

Demodulator 1 0 demodulates a carrier wave, which 
is sent from the broadcasting station and is received by 
45 the CS antenna, to obtain transport packets, and out- 
puts the obtained transport packets to TS decoder 11. 

TS decoder 11 separates the transport packets 
which belong to the video elementary stream or the vid- 
eo elementary stream from those output by demodulator 
so 1 0, and outputs the separated transport packets to input 
switching unit 22 at the side of AV decoder 12. When a 
table identifier is specified from browser 25, TS decoder 
11 detects a transport packet which has the specified 
table identifier among the plurality of transport packets 
ss of the table sub-stream, and outputs the detected trans- 
port packet to cache processing unit 21 at the side of 
browser 25. 

AV decoder 1 2. when input switching unit 22 outputs 
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a transport packet ot video elementary stream or video 
elementary stream and a PIO is specified by the AV de- 
coder controlling unit 1 3, decodes the transport packet, 
the video element, and the audio element to generate 
an AV signal synchronizing them with PCR. In generat- 
ing the AV signal by decoding, when browser 25 outputs 
the bit maps included in an NVT and when AV decoder 
controlling unit 13 instructs AV decoder 12 to superim- 
pose the bit maps on the image. AV decoder 12 super- 
imposes the bit maps output from browser 25 onto the 
decoded image, and outputs the combined image to an 
AV terminal ot the TV receiver as the AV signal. 

AV decoder controlling unit 13. when browser 25 
outputs a PID and an instruction for decoding the video 
element and audio element corresponding to the PID, 
instructs AV decoder 12 to decode the video element 
and the audio element by referring to the PID. When 
browser 25 outputs an instruction for superimposing the 
bit maps onto the image ol the video element. AV de- 
coder controlling unit 13 instructs AV decoder 12 to su- 
perimpose the bit maps onto the image of the video el- 
ement. AV decoder controlling unit 1 3 also instructs AV 
decoder 12 to change the color ol a part of the bit maps 
in display if browser 25 instructs so. 

Navigation cache unit 14, which include memories 
enabling high-speed access, stores, among a plurality 
ol NVTs included in transport streams, every NVT which 
has bit maps that may be displayed and all the NVTs 
whose bit maps having been displayed. Navigation 
cache unit 14 includes storage areas for storing NVTs. 
the storage areas having sequence numbers 1, 2, 3, 4, 
5. and 6 and display history marks lor indicating whether 
the bh maps of the stored NVT are displayed (hit or 
missed). 

FIG. 1 0A shows tho content ol navigation cache unit 
14 when the interactive screen shown in FIG 22 A is dis- 
played. As shown in FIG.22A. the interactive screen dis- 
plays icons indicating 'NEW MOVIE INFORMATION/ 
■INTERNET LATEST INFORMATION," "EVENT IN- 
FORMATION.' and "PROGRAM PREVIEW." waiting for 
the operator to input instructions for moving the cursor 
or lor determining a selected icon. According to the con- 
tent of navigation cache unit 1 4, it is recognized that 
NVTp] whose icons are currently displayed has a mark 
indicating a hit. The drawing also indicates that naviga- 
tion cache unit 14 has already stored NVT[2], NVT[3], 
NVT14), and NVT15J. Those NVTs are specified by the 
handler definition table 303 and hyper table 304 of NVT 
[11. When the operator determines one out of the icons 
indicating "NEW MOVIE INFORMATION," "INTERNET 
LATEST INFORMATION,' "EVENT INFORMATION/ 
and "PROGRAM PREVI EW f ■ th e corresponding one out 
of NVTs[2H5] is displayed on the screen. 

As will be understood from the above description, 
navigation cache unit 14 stores NVT[2]. NVT [3J, NVT 
[4], and NVT(51 whose bit maps may be displayed next 
after the current screen shown in FIG.22A 

FIG. 100 shows the content of navigation cache unit 



14 when the interactive screen shown in FIG.22B is dis- 
played. As shown in FIG.22B. the interactive screen dis- 
plays icons indicating "THE TERROR OF THE HUGE 
TORNADO (DISTRIBUTED BY AAA COMPANY)/ 
5 . XHE RETURN OF THE MONSTROUS DINOSAURS 
(DISTRIBUTED BY BBB COMPANY)/ 'SPORTS 
WARS (DISTRIBUTED BY AAA COMPANY)/ and "RE- 
TURN/ wailing for the operator to input instructions for 
moving the cursor or for determining a selection. Ac- 
io cording to the content of navigation cache unit 14, it is 
recognized that NVT[1] whose bit maps having been 
displayed and NVTI2] whose bit maps are currently dis- 
played respectively have a mark indicating a hit. The 
drawing also indicates that navigation cache unit 1 4 has 
J5 already stored NVTI111 NVT[121 ; and NVT(2ll. Those 
NVTs are specified by the handler definition table and 
hyper table ol NVT[2]. That is. navigation cache unit 14 
stores NVT[11). NVT112], and NVT1211 that may be dis- 
played next alter the current screen shown in FIG.22B. 
20 FIG. 1 0G shows the content of navigation cache unit 
14 when the interactive screen shown in FIG.22C is dis- 
played. The interactive screen including the bit maps of 
NVT[1 2] is shown in FIG.22C. According to the content 
ol navigation cache unit 14, it is recognized that NVT 
25 [1 2] whose bit maps are currently displayed has a mark 
indicating a hit. The drawing also indicates that naviga- 
tion cache unit 14has already stored NVT[41], NVT(42]. 
NVT[43]. and NVT[44]. NVTs l41J-[44] are specified by 
the handler definition table and hyper table ol NVT[12]. 
30 That is. navigation cache unit 14 stores NVTs [41H44] 
that may be displayed next after the current screen 
shown in FIG.22C. 

Note that the procedure for storing the above NVTs 
in navigation cache, unit 14, as shown in FIGs.10A. 10D, 
3S and 10G, will be described later. 

Presentation cache unit 1 5 is a memory, as naviga- 
tion cache unit 1 4, enabling high-speed accesses. Pres- 
entation cache unit 1 5 stores, among a plurality of pres- 
entation streams included in transport streams, every 
presentation stream which has a possibility of being dis- 
played and all the presentation streams having been 
displayed. Navigation cache unit 1 5 includes storage ar- 
eas for storing presentation streams, the storage areas 
having sequence numbers 1. 2, 3, 4. 5. and 6 and dis- 
<5 play history marks for indicating whether each stored 
presentation stream is displayed (hit or missed). Each 
of the storage areas also has identification information 
indicating how image information is stored in the storage 
area, that is, whether the whole image Is stored or 
so whether only the first frame is stored. 

FIG.11A shows the content of presentation cache 
unit 15 when the interactive screen shown in FIG.22A 
is displayed. According to the content of presentation 
cache unit 15. it is recognized that currently displayed 
55 presentation stream[1] has a mark indicating a hiL The 
drawing also indicates that presentation cache unit 15 
has already stored presentation stream[2l, presentation 
stream[3], presentation strearn[4], and presentation 
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streamfS] . Those presentation streams are specified by 
the hardier definition table and hyper table ol NVTI1]. 
When the operator determines one out of icons indicat- 
ing "NEW MOVIE INFORMATION.' 'INTERNET LAT- 
EST INFORMATION,' 'EVENT INFORMATION.* and 
■PROGRAM PREVIEW," the corresponding one ol 
presentation streams[2H51 is displayed on the screen. 

As will be understood from the above description, 
presentation stream cache unit 15 stores presentation 
stream[2], presentation stream[3]. presentation stream 
|41, and presentation stream[5] that may be displayed 
next alter the current screen shown in FIG.22A. 

FIG.11D shows the content of presentation cache 
unit 15 when the interactive screen shown in FIG.22B 
is displayed. According to the content, it is recognized 
that presentation slreamll] having been displayed and 
presentation slream[2] currently displayed respectively 
have a mark indicating a hit. The drawing also indicates 
that presentation cache unit 1 5 has already stored pres- 
entation stream[11]. presentation streaml12). and pres- 
entation stream[21|. That is, presentation cache unit 15 
stores presentation streaml11|. presentation stream 
p 2J, and presentation stream[2 1 ) that may be displayed 
next alter the current screen shown in FIG.22B. Those 
presentation streams are specified by the handler defi- 
nition table and hyper table of NVT12J. 

FIG.11G shows the content ol presentation cache 
unit 15 when the interactive screen shown in FIG.22C 
. is displayed. According to the content, it is recognized 
that presentation cache unit 1 5 has already stored pres- 
entation slrearns[4lH44]. That is, presentation cache 
unit 1 5 stores presentation slrcams^l H 44 l lnal mav be 
displayed next after the current screen shown in FIG. 
22C. Those presentation streams are specified by the 
handler definition tabic and hyper table of NVT[121. 

Operation detecting unit 16 receives an infrared ray 
signal from handy remote controller 4 and detects an 
operation instruction from the received infrared ray sig- 
nal. The operation instruction specifies such operations 
as follows: moving the cursor (when cross key 41 is 
pressed): and determining an icon (when enter key 43 
is pressed). Operation detecting unit 1 6 outputs the de- 
tected operation instruction to browser 25. 

Cache manager 17, when an icon is determined on 
the current screen and the next interactive screen is dis- 
played, obtains a plurality of contents that may be dis- 
played after the "next interactive screen.' Cache man- 
ager 17, while operation datecting unit 16 waits for an 
operation instruction to be input on the 'next Interactive 
screen,' instructs TS decoder 1 1 to receive presentation 
streams and NVTs with higher ranks to be displayed 
which have not bean stored in navigation cache unit 14 
or presentation cache unit 15, and instructs cache 
processing unit 21 to store the received presentation 
streams in presentation cache unit 15 and to store the 
received NVTs in navigation cache unit 14. 

The presentation streams and NVTs that may be 
displayed next are determined by cache manager 17 as 



follows: cache manager 17 refers to the hyperlink table 
ol the current NVT to determine the link-target contents, 
namely interactive screens that may be called from the 
related icons being displayed, then determines the pres- 
s entation streams and NVTs belonging to the contents. 
The presentation streams and NVTs with higher 
ranks to be displayed are determined as follows: cache 
manager 17 determines these presentation streams 
and NVTs based on (1) the statistics table showing the 
jo frequency in determination for each presentation stream 
and NVT. (2) the "rank" column in the hyperlink table of 
NVTs, (3) the icon currently in focus. 

The presentation streeams and NVTs with higher 
ranks need be determined since some NVTs may in- 
15 elude as many icons as cannot be stored in navigation 
cache unit 14, II is required that as many icons as can 
be stored in navigation cache unit 14 are selected 
among those included in such NVTs. This is the same 
tor presentation cache unit 15. 
20 Suppose the maximum number of NVTs and pres- 
entation streams that can be stored in navigation cache 
unit 14 and presentation cache unit 15 is live respec- 
tively. In this case, the link-target presentation streams 
[2H5| and NVTsl2HS] of NX/Tpi can respectively be 
2S stored in navigation cache unit 14 and presentation 
cache unit 15. On the other hand, all of the link-target 
presentation slreamsl4lH49] and NVTsl4lH49] °l 
NVTI12J cannot be stored in navigation cache unit 14 
and presentation cache unit 15. Thus the necessity for 
so selecting NVTs and presentation streams. 

In addition, presentation streams and NVTs which 
have not been stored in navigation cache unit 1 4 or pres- 
entation cache unit 15 are selected. This is because 
once a presentation stream or an NVT is stored in each 
3S unit, it is not deleted and kept to be stored (this will be 
described later). Accordingly, this operation is per- 
formed not to repeat the same operation ol storing pres- 
entation streams or NVTs in the units. 

The maximum number of NVTs and presentation 
40 streams that can be stored in navigation cache unit 14 
and presentation cache unit 15 are determined based 
on the time required to store all the NVTs and presen- 
tation streams. This is because NVTs and presentation 
streams are repeatedly sent and that receiving a desired 
as data takes as much wait time as the cycle period of rep- 
etition. The wait time increases as the number of NVTs 
and presentation streams to be received increases. 
Therefore, it may happen that the storing of NVTs and 
presentation streams does not end if the number is too 
so great. As a result, it is desirable to calculate the wait time 
and to limit the number of NVTs and presentation 
streams to be stored not to exceed the presumed wait 

time. . . 

Statistics table storing unit 15 stores the statistics 

SB table that shows the frequency in determination tor each 

presentation stream and NVT. FIG. 1 2 shov/s a statistics 

table stored in statistics table storing unit 18. As shown 

in FIG.1 2, the statistics table includes the statistics val- 
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ue for each NVT which is the number of determinations 
of the past. Note that the mean value on daily basis or 
tima-of-the-day basis or standard deviation may be 
used instead of the number ol determinations. 

Mode managing unit 19 manages the cache mode 
which indicates the best one among: (1) the statistics 
table. (2) the p rank' column in the hyperlink table, and 
(3) the icon currently in focus so that the best cache 
mode is used by cache manager 17 in generating the 
cache table. Mode managing unit 19 changes the cache 
mode according to the state of the terminal apparatus. 

Cache table storing unit 20 stores the cache table 
generated by cache manager 17. 

Cache manager 17 determines the presentation 
streams and NVTs to included in the cache table based 
on (1) the statistics table, (2) the "rank* column in the 
hyperlink table, and (3) the icon currently in focus, and 
generates the cache table. FIGS.13A-13C show cache 
tables. 

FIG.13A shows a cache table which is generated 
based on the statistics table shown in FIG. 1 2. The cache 
table shows the highest ranking link-target contents 
among those specified in the hyperlink table of NVT[1 2]. 

FIG.13B shows a cache table which is generated 
based on the "rank* column in the hyperlink table shown 
in FIG.5C. The cache table shows the highest ranking 
link-target content among those specified in the hyper- 
link table ol NVTI12). 

FIG.13C shows a cache table which is generated 
based on the icon currently in focus. More specifically, 
when a plurality of icons are displayed on the current 
screen, the possible link targets for each icon currently 
displayed are evaluated by weighting the icon in focus 
with tho highest value and by weighting icons adjacent 
to the icon in focus with the second highest value. 

Whi,le the cache table shown in F1G.13A includes 
contcnts[4i]-[45]. the cache table shown in FIG.13B in- 
cludes contcnts{45j. [47]. [46]. [43]. and (44). This ex- 
ample indicates that the contcnls of the cache table may 
greatly change depending on the cache mode. 

Cache processing unit 21 manages the start ad- 
dress and end address of each area in navigation cache 
unit 14 and presentation cache unit 15. Cache process- 
ing unit 21 increases or decreases the capacity of each 
area in navigation cache unit 1 4 and presentation cache 
unit 15 according to the size of the NVT or the presen- 
tation stream to be stored in the area. In dojng so, cache 
processing unit 21 also performs writing, reading, or a 

garbage collection. 

In the writing, cache processing unit 21 writes an 
NVT output from TS decoder 11 and a presentation 
stream output from input switching unit 22 respectively 
in navigation cache unit 14 and presentation cache unit 
15 at areas closer to the start of each unit. 

Cache processing unit 21. on receiving a read re- 
quest from cache manager 1 7. reads the requested NVT 
or presentation stream from navigation cache unit 1 4 or 
presentation cache unit 15, then outputs the read NVT 



to brov/ser 25 and the read presentation stream to input 

switching unit 22. 

In the garbage collection, cache processing unit 21 
puts a mark indicating a hit on a presentation stream or 
5 an NVT when the presentation stream or the NVT is dis- 
played; cache processing unit 21 deletes the rest of the 
presentation streams or NVTs. When free areas exist 
between the areas for the hit presentation streams or 
NVTs, cache processing unit 21 moves the hit presen- 
io tation streams or NVTs so that free areas are arranged 
in sequence. 

Input switching unit 22 transfers the transport pack- 
ets of the video elementary stream and the video ele- 
mentary stream received by TS decoder 11 to AV de- 
J5 coder 1 2. Input switching unit 22 transfers the transport 
packets of the video elementary stream and the video 
elementary stream to presentation cache unit 15 when 
Input switching unit 22 receives a switch instruction from 
cache manager 17 for switching the transfer target from 
20 AV decoder 12 to presentation cache unit 15. 

Input switching unit 22. on receiving a switch in- 
struction from cache manager 17 for using the transport 
packets in presentation cache unit 15, reads the trans- 
port packets from presentation cache unit 1 5 and trans- 
25 (srs the read transport packets to AV decoder 12. 

Graphic storing unit 23 stores the bit map for inform- 
ing the operator ol a display break. In this embodiment, 
the bit map represents a character sequence indicating 
•WAIT FOR A MOMENT. - 
30 Graphic displaying unit 24 outputs the character se- 
quence indicating 'WAIT FOR A MOMENT" stored in 
graphic storing unit 23 to AV decoder 12 when there is 
no NVT with a bit map that can be displayed. 

Browser 25 fetches PIOs of link-target video ele- 
35 men? and audio element by referring to the hyperlink ta- 
ble and PMT based on the above procedures: <Speci- 
lying Link-Target NVT> ( Specifying Link-Target Video 
Elements and Specifying Link-Target Audio Ele- 
ments and outputs the fetched PIDs to AV decoder 12 
via AV decoder controlling unit 13. Browser 25 atso in- 
structs AV decoder 1 2 to decode the video element and 
audio element related to the fetched PIDs to generate 

one AV signal. 

Browser 25, when TS decoder 11 outputs a trans- 
•*5 port packet of the NVT sub-stream, fetches bit maps 
from the transport packet and outputs the bit maps to 
AV decoder 12, with an instruction tor combining the bit 
maps with the image. Browser 25 executes a processing 
program included in the navigation information. With this 
so execution, the bit maps are displayed on the screen. 
Browser 25 instructs AV decoder controlling unit 13 to 
change the color of icons when the operator performs a 
cursor move operation. 

Now. the operation of the terminal apparatus is de- 
S5 scribed below with reference to flowcharts shown In 
FIGs. 1 4-17 on cache manager 17 and in FlGs.18-21 on 
browser 25. This is because cache manager 17 and 
brov/ser 25 take important parts among the above men- 
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tioned components in the operation of the terminal ap- 
paratus which is mainly achieved by software. 

In step S51 of the flowchart shown in FIG. 14, cache 
manager 17 sets variable p to the root number. Here, 
the variable p indicates an index number of a 'content. 
" NVT, video element, or audio element to be read, and 
the root number indicates an index number of a 'con- 
tent.' NVT, video element, or audio element which is at 
the root of the tree structure which is uniquely defined 
by PAT and PMT. In the present example shown In FIG. 
7, the root number is specified as M.' 

Suppose variable p is set to "1* in step S51. In step 
S52, demodulator 10 and TS decoder 11 receive pres- 
entation stream[p] and NVT(p] and store them in pres- 
entation cache unit 15 and navigation cache unit 14 re- 
spectively. 

Step S53 is described in detail in the flowchart 
shown in FIG.15. Note thai the flowcharts shown in 
FIGs.15-17 show processing procedures for the con- 
tents one generation later than content(p]. Here, 'the 
contents one generation later than conlent[p]" indicates 
that content[p] links to "the contents one generation later 
than conlent[pj" in the tree structure in which a content 
is linked Ircm the NVT of the previous content. In this 
case, contents one generation later than contenl[1 1 are 
contents^], [3]. I4|. and [5|. Similarly, contents two gen- 
erations later than content[l | are contenlsp 1 ]. 11 2J t (21 ]. 
1221 (23) [32]..., as shown in FIG.7. 

In step S60 of FIG.15. initial values are set lor the 
index number and the cache end flag. Hero, index 
number is a variable specifying each content in the 
cache table. Suppose in the present embodiment, the 
initial value of the index number is set to "1.* When the 
cache end flag is it indicates that the NVT and pres- 
entation stream have been stored. When the cache end 
flag is "0.* it indicates that the NVT and presentation 
stream have not been stored. Suppose in the present 
embodiment, the initial value of the cache end flag is set 
to *1 " Note that in the following description, each of a 
plurality pieces of information included in one NVT is 
represented as "NVT.NAV1.' 

Step S61 is described in detail in the flowchart 

shown in FIG. 16. 

In step S77 of FIG.16. cache manager 17 obtains a 
cache mode which is managed by mode managing unit 

In step S73, it is judged whether the cache mode is 
that of statistics value. II it is judged as yes. control goes 
to step -650. In step SSO, s higher ranking contents 
among those ranging from content(NVT[p].NAV! 
[START] link destination) to content(NVT[p].NAVl 
[END]. link destination) are registered in the cache table, 
based on the statistics value. 

II it is judged as no in step S73. control goes to step 
S79. In step S79. it is judged whether the cache mode 
is that of the 'rank" column in the hyperlink table. If it is 
judged as yes, control goes to step S51. In step S91. s 
higher ranking contents among the contents from con- 



tantiNVT[p].NAV![STARTl link destination) to content 
(NVT(p].NAVl[END].nnk destination) are registered In 
th9 cache table, based on the 'rank' column in the hy- 
perlink table. 

5 If it is judged as no in step S79, control goes to step 
S82. In step SS2. the cache table is generated, in which: 
a content including th9 icon currently in focus is deter- 
mined as rank 1; a content including an icon in the right 
or left hand side of the icon in locus is determined as 
io rank 2; a content including an upper or lower icon of the 
icon in focus is determined as rank 3: and a content in- 
cluding an icon in a slanting direction from the icon in 
focus is determined as rank 4. 

Note that in an initial stage after the terminal appa- 
is ratus has been activated, a substantially effective rank- 
ing cannot be expected for the cache modes of statistics 
value and the icon currently in focus. Accordingly, the 
initial cache mode is set to that of the 'rank* column in 
the hyperlink table by mode managing unit 19. Thus, in 
20 me present embodiment, it is judged as no in step S78 
and yes in step S79, and control goes to step S81. 

tn step S81 f s higher ranking contents among the 
contents from conl9nl(NVTlp).NAVI[STARTl.link desti- 
nation) to content(NVTlp].NAVllENDj.link destination) 
25 based on the "rank* column in the hyperlink table are 
registered in the cache table. More specifically, four 
higher ranking contents among the contents from con- 
tsnUNVTllJ.NAVIlSTARTl.content I2j) to contenl(NVT 
[p].NAVI[EN0l.content[5]). determined based on the 
so "rank" column in the hyperlink table, namely contents 
[2\-[$\ t are registered in the cache table in the order of 
the ranking. From steps of the flowchart shown in FIG. 
16. control r etu rns to step S52 in the flowchart of FIG.1 5. 
In step S62, £bntent[q] in the cache table at the po- 
55 sition of the index number is obtained. Suppose the 
cache table generated through the procedures of FIG. 
I6~includes contents[2). (31. [4]. and (5). Since in this 
cess, the index number is "1/ the first content in the 
cache table, namely, contenl[2] is obtained by cache 
*o manager 1 7. Then, in step S63. variable q is substituted 
for variable p. In step S64. NVT[p], video element[p], 
. audio element[p], a nd tne PCR of c° nlenl lPl are ob- 
tained. 

In step S65, it is judged whether navigation cache 
45 unit 14 Includes a free area with enough capacity tor 
storing NVT[p]. If not. control goes to step S67. In step 
S57. N VT[p] is stored in a marked area storing the oldest 
NVT. In the present case, since variable p is '2* and nav- 
igation cache unit 14 includes a free area with enough 
so capacity for storing NV7I2], it is judged as yes in step 
S55. allowing the control to go to step S66. In step S66, 
NvT[2) is stored in navigation cache unit 14. 

In step S33 in the flowchart of FIG. 17. the PIDs of 
video element[p] and audio elemenlfp] of presentation 
ss stream[p] are obtained. Then, in step SS4, the obtained 
FIDs are set in the TS decoder, input switching unit 22 
changes the destination of the output from input switch- 
ing unit 22 to presentation cache unit 15, then Video el- 
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ement[p] and' audio elemental are output lo input 
switching unit. 22. In this v/ay. transport packets of the 
video elementary stream and video elementary stream 
start to be received. Cache manager 17 judges whether 
presentation cache unit 15 includes a tree area with 
enough capacity for storing presentation stream[p] in 
stepScS. 

In the present cas a, since variable p is 9 2* and pres- 
entation cache unit 15 includes a free area with enough 
capacity for storing NVT(2], it is judged as yes in step 
S85, allowing the control to go to step S86. In step S8S. 
cache manager 17 stores presentation stream^J in 
presentation cache unit 1 5. 

II it is judged as no in step S85. control goes to step 
S95. In step S95, it is judged whether presentation 
cache unit 1 5 includes a Iree area with enough capacity 
for storing the first frame of presentation slream[p). If 
judged as yes, control goes to step S95. In step S96, 
the first frame is stored in presentation cache unit 15. 

If judged as not in step S95, control goes to step 
S97. In step S97. the first frame ol presentation stream 
(pj is stored in a marked area of presentation cache unit 
15 storing the oldest presentation stream, then control 
goes to step S92. 

As will be understood from the above description, 
as many whole presentation streams as possible are 
stored in presentation cache unit 15 if presentation 
cache unit 15 has enough capacity, only the first frames 
of presentation streams are stored in presentation 
cache unit 15 if presentation cache unit 15 does not 
have enough space for storing a whole presentation 
stream. 

Accordingly, high ranking presentation streams are 
stored in presentation cache unit 15 while presentation 
cache unit 15 has enough capacity. That means the 
whole video elements of the high ranking presentation 
streams are stored in presentation cache unit 15. In con- 
trast, for low ranking presentation streams, only the first 
frames the video elements of the low ranking presenta- 
tion streams are stored in presentation cache unit 15. 
This is because there Is a low possibility for the bw rank- 
ing presentation streams to be displayed. 

In step s92. the index number is incremented by 
one. In step S90, it is judged whether a content is reg- 
istered in the cache table at the position of the index 
number. If judged as yes, control goes to step S93 in 
which the cache end flag is set to "1,* then control re- 
turns to step S54. If judged as yes in step S90, control 
goes to step S62 to enter the second cycle of the pro- 
cedure. 

In step S62 of the second cycle, content[oJ in the 
cache table at the position of the index number is ob- 
tained. In the present case, the index number is current- 
ly *2" since the value has been incremented by one in 
step S92. Accordingly, the second content in the cache 
iable. namely. content[3] is obtained here. Then, in step 
S63, variable q (currently, 3) is substituted for variable 
p. In step S64. NVT13], video element|3). audio element 



[3], and the PCR of content[3] are obtained. 

Suppose in step S56, NVT|3] is stored in navigation 
cache unit 14 as the third NVT. Also suppose presenta- 
tion stream[3] including video elemental and audio el- 
s ement[3j is stored in presentation cache unit 15 as the 
third presentation stream. The index number is Incre- 
mented by one again in step S92, then control goes to 
step S62 of the third cycle. 

In step S62 of the third cycle. content[q] in the cache 
io table at the position of the index number is obtained. 
Since the index number is currently '3,* the third content 
in the cache table, namely, content[4] is obtained here. 
Then, in step S63. variable q (currently, 4) is substituted 
tor variable p. Then, in step SS4, NVT(4], video element 
15 [4j, audio element[4) ; and the PCR of conlent[4j are ob- 
tained. 

Suppose in step S5o. NVT[4) is stored in navigation 
cache unit 14 as the fourth NVT. Also suppose presen- 
tation stream[4] including video element^) and audio el- 
20 ementl4j is stored in presentation cache unit 15 as the 
lourth presentation stream. The index number is incre- 
mented by one again in step S92. then control goes to 
step S62 of the fourth cycle. 

tn step S62 of the lourth cycle. contenl[q] in the 
2S cache table at the position ol the index number is ob- 
tained. Since the index number is currently *4.* the 
lourth content in the cache table, namely. content[5] is 
obtained here. Then, in step S63, variable q (currently. 
5) is substituted for variable p. Then, in step S64, NVT 
so [5J. video element[5j : audio element[5]. and the PCR of 
content^] are obtained. 

Suppose in step S55. NVTI5] is stored in navigation 
cache unit 14 as the fifth NVT. Also suppose presenta- 
tion stream[5] including video elcmentl5j and audio el- 
js ement[5l is stored in presentation cache unit 15 as the 
fifth presentation stream. The index number is Incre- 
mented by one again in step S92. This time, it is judged 
as no in step S90. As a result, control goes to step S93 
in which the cache end flag is set to "1 and control re- 
•so turns to step S54 shown in FIG.1 4. 

In step S54 t it is judged whether an input of an op- 
eration instruction is waited for on the interactive screen. 

If judged as yes in step S54. control goes to step 
S55. In step S55, content [i] corresponding to the current 
45 interactive screen is identified. The variable i indicates 
the index number of the content currently displayed in 
the interactive screen. Then, in step S56, the Icon being 
in fucus. namely, *NVT{i].NAVI[m]" is identified, where 
variable m indicates an index number of a piece ol nav- 
so igation information including a bit map of the icon being 
in focus in NVTfil. Suppose the interactive screen shown 
in FIG.22A is currently displayed and the icon indicating 
■NEW MOVIE INFORMATION" is in locus. Under this 
condition, content[1] is identified in step S55, and 'NVT 
[1].NAVI[1]" is identified in step S56. 

In step S57, a link-target contentjk] specified by the 
hyperlink information of navigation information 'NX/Tp]. 
NAVl[m]* is obtained. Then, in step S59, variable k is 
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substituted forvariable p. Control returns to step S53 so 
that 'the contents one generation later than contentfp]* 
are read. 

In the present case, link-target content[2] specified 
by the hyperlink information of navigation information 
"NVT[1].NAVI[1]" is obtained. Then, in step S59, varia- 
ble k (currently. 2) is substituted for variable p. Control 
returns to step S53 so that 'the contents one generation 
later than content^]* are read. In step S53 ( contents 
[11], 1 121. and [21] are read. 

Now. the operation of the terminal apparatus is de- 
scribed with reference to the flowcharts shown in FIGs. 
18-21 related to browser 25. 

After the terminal apparatus is activated, browser 
25 sets variable i to the root number in step S2 shown 
in FIG. 18. In step S3. NVTli], video elemenl[i], and audio 
elemenlli] are obtained. In step S4, the interactive 
screen generated from the obtained NVT[i], video ele- 
menlli]. and audio elemenl[i] is displayed. 

Step S4 is described in detail in the flowchart shown 
in FIG.19. 

In the flowchart shown in FIG.19, browser 25 oper- 
ates lor switching the interactive screen at high speed. 

In step S21, il is judged whether presentation 
stream^] is stored in presentation cache unit 15. II 
judged as yes, control goes to step S22. In slep S22. 
cache processing unit 21 is instructed to read presen- 
tation streaml'i] from presentation cache unit 15. In slep 
S23. input switching unit 22 is instructed so that streams 
are distributed to AV decoder 12 from presentation 

cache unit 15. 

II judged as no in step S21 . control goes to step S25. 
In step S25. it is judged whether the first frame of pres- 
entation stream[i] is stored in presentation cache unit 
15. If judged as yes, control goos to step S26. In step 
S25. cache processing unit 21 is instructed to read the 
first tramo ol presentation stream[i] from presentation 
cache unit 15. In step S27. input switching unit 22 is in- 
structed so thai streams are distributed to AV decoder 
1 2 from presentation cache unit 1 5. In step S23, AV de- 
coder controlling unit 13 is instructed to issue the PIDs 
of video element[i] and audio element[i] to AV decoder 
12. and the first frame of presentation stream[i] in pres- 
entation cache unit 15 is displayed. 

If it is judged as no in step S25, control goes to step 
S29. In step S29. graphic displaying unit 24 outputs the 
character s equence indicating "WAIT FOR A MOMENT* 
stored in graphic storing unit 23 to AV decoder 12 so 
that the character sequence is displayed on the screen, 
the screen being displayed as a default screen. 

In step S30, input switching unit 22 is instructed so 
that streams are distributed to AV decoder 1 2 from TS 
decoder 11. 

In step S24. AV decoder controlling unit 13 is in- 
structed so that the PIDs of video elementp] and audio 
element[i] are issued to AV decoder 12. With such an 
arrangement. AV decoder 12 decodes either of the pres- 
entation stream read from presentation cache unit 15 



and the presentation stream received by TS decoder 11 
using the PIDs sent from AV decoder controlling unit 1 3. 

In step S31 shown in FIG.20. it is judged whether 
NVT[i] is stored in navigation cache unit 1 4. If judged as 
5 yes. control goes to step S32. In step S32, NVT[i] Is 
fetched from navigation cache unit 1 4. 

If judged as not in step S31. control goes to step 
S42. In step S42, an icon display instruction is issued to 
graphic displaying unit 24. Graphic displaying unit 24, 
io on receiving this instruction, displays the character se- 
quence "WAIT FOR A MOMENT' stored in graphic stor- 
ing unit 23, as the default screen. 

In step S43. the table identifier of NVT[i] is output 
to the TS decoder. In step S44. the TS decoder is in- 
is structed to receive NVT[i]. In step S45, it is judged 
whether NVT[i] has been received. If judged as yes, con- 
trol goes to slep S45. 

In step S4S. all the bit maps included in *NVT[i]. 
NAVI [slart]*-'NVT[i].NAVUend]' are transformed for 
20 display. In slep S47 t the transformed bit maps are output 
to the AV decoder. In step S48, the AV decoder com- 
bines the transformed bit maps wilh the image which is 
the decoded presentation stream[i]. In step S49 shown 
in FIG.21. it is judged whether NVT[ij has been stored 
25 in navigation cache unit 14. II judged as yes, control 
goes to step S101. In step S101, the NVTli] stored in 
navigation cache unit 14 is marked. If judged as no in 
slep S49. control goes to step SI 00 in which NVTli] is 
stored in navigation cache unit 14 with a mark. 
30 In step SI 02. it is judged whether presentation 
stream^] has been stored in presentation cache unit 15. 
If judged as yes. control goes lo step S104. In step S104. 
the presentation stream[i] stored in presentation cache 
unit 15 is marked. If judged as no in step S102. contro! 
3S goos to step Si 03 in which presentation stream[i] is 
stored in presentation cache unit 1 5 with a mark. 

In step S106. the cache end flag is set to 0. In step 
S107. variable m is set to 1. In step S103, the bit map 
of NVT[i].NAVlm] is made to be in locus. Note that in the 
40 present embodiment, a bit map specified by the first 
piece of navigation information is made to be in focus. 
However, a bit map specified by any piece of navigation 
information may be made to be in focus. Control returns 
to step S5 shown in FIG. 13. 
45 In step S5, it is judged whether an operation instruc- 
tion has bean input on the interactive screen. If judged 
as yes in step S5 by operation delecting unit 16, control 
goes to step S6. In step So, it is judged whether the op- 
eration specified by the operation instruction is a deter- 
so mination operation. If judged as no, control goes to step 
S7. In step S7, it is judged whether the operation spec- 
ified by the operation instruction is a cursor move oper- 
ation. 

If judged as yes. control goes to step Sc. In step Se. 
ss the state of being in focus is cleared for the bit map of 
NVT[i].NAYI[m]. In step S9, variable m is updated to in- 
dicate a link-target index number. In step S10, the bit 
map of NVT]i].NAVI(m] is made to be in focus. Control 
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returns to step S5. 

If it is Judged that the input operation is the determi- 
nation operation in step S6. control goes to step S11. In 
step S11, the bit map of NVT[i].NAVl[m] is made to be 
in the determination state. In step S1 2. a link-target con- 
tent[k] specified by NVT[i].NAV1[m] in the hyperlink table 
is obtained. In step SI 3. NVT[k], video elemental and 
audio element[k] are obtained. In step S1 4. the statistics 
value (or NVT(k] in the statistics table is incremented by 
one. In step S15. "k" is substituted lor "i." In step S16. 
the presentation streams and NVTs without marks are 
respectively deleted from presentation cache unit 15 
and navigation cache unit 14. In step S 18. it Is judged 
whether the cache end flag is '1/ Control stays at step 
S13 until the cache end flag is "1." This indicates that 
the next operation is not started until cache manager 17 
completely stores the presentation streams and NVTs 
one generation later into presentation cache unit 1 5 and 
navigation cache unit 1 4 respectively. In case the repro- 
duction of the presentation stream ends while the next 
operation is not started in the above process, browser 
25 repeals reproduction of the presentation stream, 
keeps on displaying a still image of the last frame or the 
like. If it is judged as yes in step S18. control returns to 
S4. 

Now, the operation on the contents shown in FIG. 7 
is described, based on the above flowcharts. 

FIG.22A shows the interactive screen generated 
from NVTI1]. video elemcntp], and audio element[1] in 
step S4 and is displayed on TV receiving unit 3. The 
interactive screen is composed ol a shot image gener- 
ated from presentation stream[1 ] and several icons su- 
perimposed on the shot image. The voice of an an- 
nouncer is output. While the interactive screen is dis- 
played, cache manager 1 7 obtains contenls[2], [3J, [4], 
and [5] specified in the handler definition table 302 and 
hyperlink table 304 of NVT(1). Then, presentation 
streams [2]. (3). [4J, and [5] are stored in presentation 
cache unit 15 via demodulator 10 and TS decoder 11. 
Similarly. NVTs[2], [3]. [41, and [5] are stored in naviga- 
tion cache unit 1 4 via demodulator 10 and TS decoder 
11. 

Currently displayed presentation stream[1] and 
NVTpl are marked respectively in presentation cache 
unit 15 and navigation cache unit 14 ; in steps 101 and 
104. FIG.10A and FIG.11A respectively show the con- 
tents of navigation cache unit 1 4 and presentation cache 
unit 15 after the above operation. 

When the operator determines an icon indicating 
■NEW MOVIE INFORMATION' on the current screen, 
the processing goes through steps S11 to S18 and re- 
turns to step S4 in which browser 25 displays the Inter- 
active screen generated from NVT12). video elemental, 
and audio element[2|. FIG.22B shows the interactive 

screen at this stage. 

Currently displayed presentation stream[2] and 
NVT[2] are marked respectively in presentation cache 
unit 15 and navigation cache unit 14, in steps 101 and 



104. FIG. 108 and FIG.11B respectively show the con- 
tents of navigation cache unit 1 4 and presentation cache 
unit 15 after the above operation. 

After presentation stream[2] and NVT[21 are dts- 
s played as described above, areas without marks are de- 
leted from navigation cache unit 14 and presentation 
cache unit 15. FIGs.lOC and 11C respectively show the 
contents of navigation cache unit 14 and presentation 
cache unit 15 after the above operation. 
io While the interactive screen is displayed, cache 
manager 17 obtains contents[11], (12]. and [211 speci- 
fied in the hyperlink information of NVT[2). Then, pres- 
entation streams[11]. [121. and [21] are stored in pres- 
entation cache unit 15 via demodulator 10 and TS de- 
T£ coder 11. Similarly, NVTS[11], [12], and [21] are stored 
in navigation cache unit 14 via demodulator 10 and TS 
decoder 11. FIGs.100 and 11D respectively show the 
contents of navigation cache unit 14 and presentation 
cache unit 15 after the above operation. 
20 Suppose the operator determines an icon indicating 
•THE TERROR OF THE HUGE TORNADO (DISTRIB- 
UTED BY AAA COMPANY)." Then, the processing goes 
through steps St 1 to S1 8 and returns to step S4 in which 
browser 25 displays the interactive screen generated 
2S from NVT[12], video elemenl[12], and audio element 
[1 2|. FIG.22C shows the interactive screen displayed at 
this stage. 

Currently displayed presentation stream[12] and 
NVT(l2] are marked respectively in presentation cache 
30 unit 15 and navigation cache unit 14. in steps 101 and 
10-:. FIG.10E and FIG.11E respectively show the con- 
tents of navigation cache unit 1 4 and presentation cache 
unit 15 after the above operation. 

After presentation stream[l2] and NVT[12] are dis- 
35 played as described above, areas without marks are de- 
leted from navigation cacho unit 14 and presentation 
cache unit 15. FIGs.lOF and 11F respectively show the 
contents of navigation cache unit 14 and presentation 
cache unit 15 after the above operation. 
40 While the interactive screen is displayed, cache 
manager 17 obtains contents[41]-[49] specified in the 
hyperlink information of NVT[l2J. Then : presentation 
streams[41 ]-[49J and NVTs[41 ]-[49] are attempted to be 
stored respectively in presentation cache unit 15 and 
<$ navigation cache unit 14. However, as shown in FIGs. 
10F and 11F, there are only two free areas in each of 
the tables. As a result, presentation streams[41] and 
[42] and NVTs[4l] and [42] are stored in two areas, re- 
placing with two oldest presentation streams and NVTs 
so respectively in presentation cache unit 15 and naviga- 
tion cache unit 14. Presentation streams[43] and 144] 
and NVTs[43] and [44] are stored in two free areas of 
pres entation cache unit 1 5 and navigation cache unit 1 4, 
respectively. FIGs.lOG and 11G respectively show the 
ss contents ol navigation cache unit 14 and presentation 
cache unit 15 after the above operation. 

Now. the operation corresponding to the determina- 
tion of "RETURN* icon is described Suppose the oper- 
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ator determines an icon indicating 'RETURN* in the in- 
teractive screen as shown In FIG.22B. By referring NVT 
(21, it is determined that the icon is related to the index 
number 4, and that the link-destination is content[1]. 

FIG. 1 0B and FIG.11B respectively show the con- 
tents of navigation cache unit 1 4 and presentation cache 
unit 15 at this stage. As will be understood Irom the ta- 
bles shown in FIG.10B and FIG.11B, NVT[1] and pres- 
entation stream[1l, namely, the above link targets, have 
already been stored. Accordingly, NVT[1] and presen- 
tation stream[1 ] can immediately be obtained Irom these 
tables and displayed as the interactive screen as shown 

in FIG.22A. . . 

When the operator determines an icon indicating 
"NEW MOVIE INFORMATION* here, the interactive 
screen shown in FIG.22B is immediately displayed 
since presentation slream[2] and NVT[2| are stored in 
presentation cache unit 15 and navigation cache unit 14 
with marks, respectively. As will be understood Irom the 
above description, the construction in which presenta- 
tion streams and NVTs are stored in presentation cache 
unit 15 and navigation cache unit 14 with marks 
achieves the high-speed return to the previous screen 
responding to the determination ol the "RETURN" icon. 

As has been described above, the TV broadcasting 
system ol the present embodiment enables an immedi- 
ate display ol an interactive screen since the link-target 
NVT and presentation stream can immediatery be ob- 
tained (rom navigation cache unit 14 and presentation 
cache unit 1 5 and displayed, responding to the determi- 
nation ol one icon in the previous screen. 

The TV broadcasting system ol the present embod- 
iment also enables storage ol a plurality ol presentation 
streams and NVTs which have possibility of being dis- 
played next in presentation cache unit 1 5 and navigation 
cache unit 14 in advance while the current interactive 
screen is displayed. 

The above operation also has an effect that the op- 
erator does not recognize the storing ol presentation 
streams and NVTs since the storage is done while the 
TV broadcasting system waits for an input of an opera- 
tion instruction on the currently displayed interactive 
screen. <Second Embodiment 

The present embodiment achieves a TV broadcast- 
ing system which uses video elements including still pic- 
tures while the TV broadcasting system of the first em- 
bodiment uses video elements which include only mo- 
tion pictures. 

FIG 23 shows the contents of the transport streams 
broadcast in the present embodiment. Each of VE[0]. 
VE[1]. VE[2],... includes still pictures. While in the first 
embodiment, each video element has a different PID, in 
the second embodiment, each video element has a 
common PID which Is "0x0064/ as shown in FIG.23. 
This is because it is intended in the second embodiment 
that a large number of still pictures are broadcast and 
that the length ol the PID is not enough for assigning a 
unique identifier to each video element Though each 
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video element has a common PID. it has another Iden- 
tifier called 'stream Jd. - In FIG.23. for example, VE(0] 
has streamjd 'OxeO." and VE[1] has streamed '0xe1 
as well as a common PID, "0x0084.* 

While in the first embodiment, the transport stream 
is composed ol a sequence of video elements, in the 
second embodiment, the transport stream Includes a 
private section called video element table (VET) be- 
tween video elements. As shown in FIG.23, for example. 
VET[15] is inserted in immediately before VE[0], VET 
[ 1 6 1 in immediately bef or e VE[ 1 1. Similarly, th e transport 
stream ol the present embodiment includes a private 
section called audio element table (AET) between the 
audio elements. 

FIG.24A shows the content ol VET(1 5]. VETf, 1 5] in- 
cludes an identifier called VE_id_extension whose val- 
ue is "0x000 1 ." which is unique to VET[1 5J. VET[1 5] also 
includes a PID. "0x0083." Though VET[151 is inserted 
in immediately before VE[0). it has the streamed *0xef 
ol VE[1 5J which is at a position about a dozen VEs away. 

FIG. 243 shows the content ol VET[16J. VETJ16J in- 
cludes VE_id_exlension whose value is "0x0000/ 
which is unique to VET[i61. VET[16J also includes the 
same PID. "0x0083," as that ol VETpS). Though VET 
116] is inserted in immediately belore VEpj, it has the 
streamjd "OxeO" ol VE[151 which is at a position about 
a dozen VEs away. In this way. each VET has the 
streamjd ol a corresponding VE which is at a position 
a certain number ol VEs away. 

FIG. 25 shows a content ot a hyperlink table in an 
NVT of the second embodiment. The hyperlink table of 
the second embodiment dillers Irom that ol the lirsl em- 
bodiment in that it includes "VE Jd_extension" 2547 in- 
stead of "VE.compjag" and "AE_id_extension* in- 
stead ot " AE.comp Jag." The "VE Jd extension* column 
and "AEJd.extension" column respectively show a 
VE_id extension ol a VET and an AEJd.extension of 
an AET. For example. "0x0000" and "0x0001" included 
in "VE id extension" 2547 shown in FIG.25 are 
VEJd.extensions of VET(161 and [15], respectively. 
This indicates that the hyperlink table defines link-target 
VETs 

From the above description, the following proce- 
dures are required in the second embodiment for chang- 
ing still pictures. 

A VEJd.extension written in hype rt ink table -* a 
VET with tha~VE Jd_extension -» a streamjd included 
in the VET -» a VE with the streamjd 

cache manager 1 7 operates as follows in the sec-. 

ond embodiment. 

When the operator determines an icon on an inter- 
active screen, cache manager 17 detects an HDJndex 
number corresponding to the determined icon by refer- 
ring to the object definition table, detects an HLJndex 
number corresponding to the HDJndex number by re- 
ferring to the handler definition table, and detects a 
VEJd_extensicn corresponding to the HLJndex 
number by referring to the hyperlink table. Cache man- 
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ager 17 allows demodulator 10 and TS decoder 11 to 
receive a VET having the detected VEJd extension 
among the plurality of VETs included In the transport 
stream. Cache manager 17 fetches a stream Jd and a 
component jag from the received VET. Cache manager s 
17 letches a PIO corresponding to the component Jag 
from the PMT. Cache manager 17 v/aits for a VE with 
the streamjd and the PID to be transmitted, if the VE 
is transmitted, cache manager 17 receives it. 

Alter receiving a link-target VE in the above proce- »o 
dure, cache manager 17 also receives a link-target AE 
in a similar procedure. Cache manager 17 instructs in- 
put switching unit 22 to store the received VE and AE 
into presentation cache unit 15 as a presentation 
stream. 

With the above construction, it is possible for the 
digital satellite broadcasting system, which broadcasts 
a targe number of still pictures, to display interactive 
screens including a still picture specified as a link des- 
tination by a determination operation in another interac- 20 
live screen. This is achieved by the reference of VETs 
included between VEs in the transport stream. 

The two embodiments described above are exam- 
ples of the present invention with which best effects are 
expected. It is also possible to change the embodiments 2S 
as follows: 

(a) In the present embodiment the highest rank in 
the navigation information is indicated, by integer 
" 1 However, the highest rank may be integer "255" so 
which is the highest value lor e-bit data in binary 
notation. 

(B) In the present embodiments, mode managing 
unit 19 manages the cache mode in cache manager 

1 7. However, the operator may input an instruction 35 
for changing a cache mode to another cache mode. 
Alternately, an NIT including the cache mode may 
be transmitted. 

(C) In the present embodiments, cache processing 
unit 21 processes both navigation cache unit navi- 
gatioR cache unit 14 and presentation cache unit 
15. However, navigation cache unit navigation 
cache unit 14 and presentation cache unit 15 may 
be processed by other two units, respectively. 

(D) In the present embodiments, cache manager 17 « 
suspends the reproduction until the cache end flag 

is set to M." However, the reproductiorvmay be con- 
tinued without suspension. 

(E) In the present embodiments, cache manager 17 
stores each NVT and presentation stream sepa- so 
rately in navigation cache unit 14 and presentation 
cache unit 15 respectively. However, demodulator 

1 10 and TS decoder 11 may receive a plurality ol: 
NVTs and presentation streams in a transport 
stream at each reception so that they are stored in *s 
navigation cache unit 14 and presentation cache 
unit 1 5 with batch processing. 

(F) In the present embodiments, cache processing 



unit 21 deletes presentation streams or NVTs for ef* 
fecfrve use of the memory. However, the presenta- 
tion streams or NVTs may not be deleted and be 
used again if the memory capacity allows it 

(G) In the present embodiments, presentation 
streams and NVTs one generation later than the 
content related to the determined icon are read in 
advance. However, a certain number of presenta- 
tion streams and NVTs may be selected from those 
one generation later and two generations later than 
the current content and be read in advance. 

(H) In the present embodiments, presentation 
streams or NVTs without marks are deleted. How- 
ever, presentation streams or NVTs to be deleted 
may be determined based on the number of times 
they have been displayed in past, with a certain 
threshold value. 

(I) Presentation cache unit 15 may be deleted from 
the construction. In such a case, the system oper- 
ates as follows: 

cache manager 17 obtains only NVTs having 
possibility of being displayed according to a current 
NVT in navigation cache unit 14 and stores them in 
navigation cache unit 14 while an input of an oper- 
ation instruction is waited for on an interactive 
screen. 

When the operator determines an icon on the 
interactive screen, the link-target content is deter- 
mined referring to the current NVT. 

If the link-target NVT has been stored in navi- 
gation cache unit 14. the link-target presentation 
stream is obtained according to the link-target NVT 
and is stored in navigation cache unit 14. The NVT 
and presentation stream are displayed. Such a con- 
struction takes more time in displaying the link-tar- 
get NVT and presentation stream since they are ob- 
tained one by one. However, it has a merit of delet- 
ing presentation cache unit 15 Irom the construc- 
tion. Further, in case the link-target interactive 
screen is composed ol only the bit maps specified 
by an NVT, the presentation stream need not be ob- 
tained. This provides an effect of simplifying the 
construction and speeding up the display of the in- 
teractive screen. 

(J) Navigation cache unit 1 4 may be deleted from 
the construction, and presentation cache unit 15 
may store only presentation streams. 
(K) In the second embodiment, VEs including still 
pictures are .identified by using 'streamjd.' How- 
ever, different PIDs may be used instead of 
■streamjd." On the other hand, though in the first 
embodiment, VEs including motion pictures are 
identified by using different PIDs, a common PID 
and 'stream Jd* may be used instead. 
(U) The procedure of the caching manager or the 
browser may be written in a machine-language pro- 
gram and be recorded in a record medium such as 
an IC card, optical disc, or floppy disk. The recorded 
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machine-language program is installed on a gener- 
al-purpose hardware apparatus for use. where the 
general-purpose hardware apparatus indicates a 
personal computer which is connected to a parabol- 
ic antenna and includes built-in decoder, TS decod- 
er, and AV decoder. Such a personal computer ex- 
ecutes the installed machine-language program to 
achieve the features of the present apparatus de- 
scribed in the first and second embodiments. 
(M) In the first embodiment, as many whole pres- 
entation streams as possible are stored in presen- 
tation cache unit 15. However, only the first frames 
or representative frames may be stored instead. 

Although the present invention has been fully de- 
scribed by way of examples with reference to the ac- 
companying drawings, it is to be noted that various 
changes and modifications will be apparent to those 
skilled in the art. Therefore, unless such changes and 
modifications depart from the scope of the present in- 
vention, they should be construed as being included 
therein. 



Claims 



1. A terminal apparatus lor displaying an image by re- 
producing one out ol m pieces ol image information 
and for interactively changing the image using n 
pieces of navigation information, wherein the image 
is one of a moving picture, a still picture, and a mix- 
ture ol a moving picture and a still picture, wherein 
the m pieces ol image information and the n pieces 
of navigation inlormation together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece of navigation information is re- 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than M," the terminal 
apparatus including: 

cache means for storing a pair of one out of the 
m pieces of image information and one out of 
the n pieces of navigation information; 
reproducing means for reproducing the one out 
of the m pieces ol image information stored in 
the cache means: 

monitoring means for monitoring whether an 
operator has performed a certain operation re- 
sponding to the image displayed; 
receiving means tor. before the monitoring 
means determines that the operator has per- 
formed the certain operation, receiving s pieces 
of image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces ol 
image information based on the one out ol the 



n pieces of navigation information stored in the 
cache means, and storing the s pieces of image 
information and the t pieces of navigation infor- 
mation in the cache means, wherein s Is an in- 
s teger satisfying 1 £s<m. and t is an Integer sat- 

isfying l£5t<n; 

specifying means for specifying one out of the 
plurality pieces ol link-target image information 
based on the certain operation when the mon- 

io itoring means monitors that the operator has 

performed the certain operation; 
identifying means for identifying the one out of 
the plurality pieces ol link-target image informa- 
tion specified by the specifying means as one 

is out the s pieces of image information stored In 

the cache means; and 

first controlling means for reading the piece of 
link-target image information identilied by the 
identifying means and instructing the reproduc- 
20 ing means to reproduce the piece of link-target 

image information, and instructing the receiving 
means to receive other s pieces ol image infor- 
mation and other I pieces of navigation infor- 
mation based on one out of the I pieces ol nav- 
2S igation inlormation in the cache means corre- 

sponding to the piece o! link-target image infor- 
mation identilied by the identilying means. 

2. The terminal apparatus of Claim 1 further compris- 
30 ing: 

superimposing means lor superimposing, 
based on a piece of navigation information cor- 
responding^ to the one out of the m pieces of 
35 image information stored in the cache means, 

a plurality of icons on the image which is dis- 
played when the reproducing means reproduc- 
es the one out of the m pieces of image infor- 
mation, wherein 
40 the monitoring means includes: 

a determination operation detecting unit for de- 
tecting a determination operation performed on 
one out of the plurality of icons, wherein 
the identifying means identifies one out of the 
45 plurality pieces of link-target image information 

detected by the determination operation detect- 
ing unit. 

3. The terminal apparatus of Claim 2 further compris- 
so ing: 

default image reproducing means for. when the 
identifying means fails to identify the one out of 
the plurality pieces of link-target image informa- 
55 lion specified by the specifying means, repro- 

ducing a default image; and 
second controlling means for instructing the re- 
ceiving means to receive the piece of link-target 
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image Information specified by the specifying 
means when the piece of link-target image in- 
formation is not identified by the identifying 
means, and to receive a piece of navigation in- 
formation corresponding to the piece of link-tar- 
get image information specified by the specify- 
ing means, and storing the received piece of 
link-target imag9 information and the corre- 
sponding piece of navigation information in the 
cache means, wherein 

the superimposing means superimposes a plu- 
rality of icons on the image based on the piece 
of navigation information received by the re- 
ceiving means. 

4. The terminal apparatus of Claim 2. wherein 

the reproducing means includes: 
focus setting means for making one out ol the 
plurality of icons be in locus, wherein 
the monitoring means includes: 
a cursor move operation detecting unit for de- 
tecting a cursor move operation; and 
a focus changing unit tor making another one 
out of the plurality of icons be in locus based 
on the cursor move operation delected by the 
cursor move operation detecting unit, wherein 
the determination operation detecting unit de- 
tects a determination operation performed on 
the other one out ol the plurality ot icons in lo- 
cus. 
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5. The terminal apparatus of Claim 1 further compris- 
ing: 

rank setting means for setting ranks of the m 
pieces of imago information stored in the cache 
means based on possibility ol being displayed; 
and 

cache table registering means for registering 
identifiers of high ranking s pieces of image in- 
formation in a cache table, out ot the m pieces 
of image information and registering identifiers 
of t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 
information, wherein 

the receiving means receives the s pieces of 
image information whose identifiers are regis- 
tered by the cache table registering means and 
receives t pieces of navigation information cor- 
responding to the s pieces of image informa- 
tion. 

6. The terminal apparatus of Claim 5 further compris- 
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to be in focus by the locus setting means, and 
for weighting, with a second highest value, 
icons adjacent to the one in focus, wherein 
the rank setting means sets ranks of the m piec- 
es of image information based on values 
weighted by the weighting means. 

7. The terminal apparatus ot Claim 6 further compris- 
ing: 

deleting means for deleting, out of the identi- 
fiers of high ranking s pieces of image information 
and t pieces of navigation information in the cache 
table. Identifiers ol pieces of image information and 
pieces of navigation information which have been 
stored in the cache means. 

8. The terminal apparatus ol Claim 7, wherein 



the receiving means includes: 
a receiving unit lor receiving, out of the s pieces 
of image information and I pieces ol navigation 
information with corresponding identifies regis- 
tered in the cache table, a piece ol image inlor- 
mation with a highest rank and a piece of nav- 
igation information corresponding to the piece 
ol image information with the highest rank, 
wherein 

the terminal apparatus includes: 
data size judging means for judging whether 
capacity of a free area in the cache means ex- 
ceeds a data size of the piece ot image inlor- 
mation with the highest rank and the piece of 
navigation information corresponding to the 
piece ot image information with the highest 
rank: and 

writing means for writing the piece of image in- 
formation with the highest rank and the corre- 
sponding piece of navigation information into 
the free area when the data size judging means 
judges that the capacity of the tree area ex- 
ceeds the data size of the piece of image infor- 
mation with the highest rank and the corre- 
sponding piece of navigation information, 
wherein 

the receiving unit receives a piece of image in- 
formation with a second highest rank and a 
piece ol navigation information corresponding 
to the piece of image information with the sec- 
ond highest rank after the writing means writes 
the piece of image information with the highest 
rank and the corresponding piece of navigation 
information into the free area. 
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weighting means for weighting, with a highest 
value, the one out of the plurality of icons made 



9. The terminal apparatus ot Claim 8, wherein 

the data size Judging means includes: 

a frame size judging unit for, when the data size 

judging means judges that the capacity of the 
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free area in ihe cache means does not exceed 
the data size of the piece of image information 
with the highest rank and the corresponding 
piece of navigation information, judging wheth- 
er the capacity of the free area in the cache 
means exceeds the data size of a frame of the 
piece of image information with the highest rank 
and a piece of navigation information corre- 
sponding to the piece of image information with 
the highest rank, wherein 
the writing means includes: 
a Irame writing unit for writing the frame ol the 
piece of image information with the highest rank 
and the piece of navigation information corre- 
sponding to the piece ol image information with 
the highest rank into the Iree area when the 
frame size judging unit judges that the capacity 
of the free area in the cache means exceeds 
the data size of the frame of the piece ol image 
information with the highest rank and the piece 
of navigation inlormation corresponding to the 
piece ol image inlormation with the highest 
rank. 

10. The terminal apparatus ol Claim 9. wherein 

the data size judging means lurther includes: 
an oldest image information delecting unit for, 
out ol the image information and the navigation 
information stored in the cache means, detect- 
ing a piece ol oldest image inlormation and a 
piece ol oldest navigation inlormation when the 
frame size judging unit judges that the capacity 
of the tree area in the cache means does not 
exceed the data size ol the Irame of the piece 
ol image information with the highest rank and 
the piece ol navigation inlormation correspond- 
ing to the piece ol image inlormation with the 
highest rank, wherein 

the Irame writing unit overwrites the frame ol 
the piece of image information with the highest 
rank and the corresponding piece ot navigation 
information in an area in which the piece of old- 
est image information and the piece of oldest 
navigation information are stored. 

11. The terminal apparatus of Claim 7 further compris- 
ing: 



hit pair determining means for determining, as 
a hit pair, a pair of a piece of image information 
and a piece of navigation information which are 
specified by the operator by determining a cor- 
responding icon out of the image information 
and the navigation information stored in the 
cache means; 

mark assigning means for assigning a mark in- 
dicating a hit to the pair of the piece of image 



information and the piece of navigation infor- 
mation determined as the hit pair by the hit pair 
determining means; and 
area freeing means for freeing areas to which 
s the mark is not assigned by the mark assigning 

means, out of the imag9 information and the 
navigation information stored in the cache 
means. 

io 12. The terminal apparatus of Claim 5 further compris- 
ing: 

statistics value storing means for storing a sta- 
tistics value for each piece of image information 
which indicates a number of times the piece of 
image inlormation has been determined, 
wherein 

the rank setting means sets ranks o! the m piec- 
es ol image information based on the statistics 
value for each piece of image information. 
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13. The terminal apparatus ol Claim 12. wherein 

the monitoring means includes; 
an incrementing unit lor incrementing, by one. 
a statistics value for a piece of image informa- 
tion when the piece of image information is de- 
termined. 

14. The terminal apparatus of Claim 1 3 lurther compris- 
in 9 : 

deleting means for deleting, out of the identi- 
fiers of high ranking s pieces ol image information 
and t pieces oKnavigation inlormation in the cache 
table, identifiers ol pieces of imago information and 
pieces of navigation information which have been 
stored in the cache means. 

15. The terminal apparatus ot Claim 14, wherein 
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the receiving means includes: 
a receiving unit for receiving, out of the s pieces 
of Image information and t pieces of navigation 
information with corresponding identifies regis- 
tered in the cache table, a piece ol image infor- 
mation with a highest rank and a piece of nav- 
igation information corresponding to the piece 
of image information with the highest rank, 
wherein 

the terminal apparatus includes: 
data size judging means for judging whether 
capacity of a free area in the cache means ex- 
ceeds a data size of the piece ol image Infor- 
mation with the highest rank and the piece of 
navigation information corresponding to the 
piece ol Image information with the highest 
rank; and 

writing means for writing the piece of Image in- 
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formation with the highest rank and the corre- 
sponding piece of navigation Information into 
the free area when the data size judging means 
judges that the capacity of the free area ex- 
ceeds the data size of the piece of image infor- 
mation with the highest rank and the corre- 
sponding piece of navigation information, 
wherein 

the receiving unit receives a piece of image in- 
formation with a second highest rank and a 
piece of navigation information corresponding 
to the piece of image information with the sec- 
ond highest rank after the writing means writes 
the piece of image information with the highest 
rank and the corresponding piece of navigation 
information into the Iree area. 

16. The terminal apparatus of Claim 15. wherein 



the data size judging means includes: 20 
a frame size judging unit for, when the data size 
judging means judges that the capacity of the 
free area in the cache means does not exceed 
the data size of the piece of image inlormation 
with the highest rank and the corresponding 2S 
piece of navigation information, judging wheth- 
er the capacity of the free area in the cache 
means exceeds the data size of a frame o! the 
piece of image information with the highest rank 
and a piece of navigation information cbrre- .30 
sponding to the piece of image information with 
the highest rank, wherein 
the writing means includes: 
a frame writing unit for writing tho frame of the 
piece ol imago information with the highest rank 35 
and the piece of navigation information corre- 
sponding to the piece of image information with 
the highest rank into the tree area when the 
frame size judging unit judges that the capacity 
of tho free area in the cache means exceeds -« 
the data size of the frame of the piece of image 
information with the highest rank and the piece 
of navigation information corresponding to the 
piece of image information with the highest 
rank. 

17. The terminal apparatus of Claim 16. wherein 
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the data size judging means further includes: 
an oldest image information detecting unit for, 
out of the image information and the navigation 
information stored in the cache means, delect- 
ing a piece of oldest image information and a 
piece of oldest navigation information when the 
frame size judging unit judges that the capacity 
of the free area in the cache means does not 
exceed the data size of the frame of the piece 
of image information with the highest rank and 
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the piece of navigation information correspond- 
ing to the piece of image Information with the 
highest rank, wherein 

the frame writing unit overwrites the frame of " 
the piece of image information with the highest 
rank and the corresponding piece of navigation 
information in an area in which the piece of old- 
est image inlormation and the piece of oldest 
navigation information are stored. 

IB. The terminal apparatus of Claim 14 further compris- 
ing- 

hit pair determining means for determining, as 
a hit pair, a pair of a piece of image information 
and a piece of navigation information which are 
specified by the operator by determining a cor- 
responding icon out of the image information 
and the navigation information stored in the 
cache means; 

mark assigning means lor assigning a mark in- 
dicating a hit to the pair of the piece of image 
information and the piece of navigation inlor- 
mation determined as the hit pair by the hit pair 
determining means; and 
area freeing means lor freeing areas to which 
the mark is not assigned by the mark assigning 
means, out of the image information and the 
navigation information stored in the cache 
means. 

19. The terminal apparatus ol Claim 5 further compris- 
ing: 

rank inlormation detecting means for detecting 
a piece of rank information from the piece of 
navigation inlormation corresponding to the 
one out of the m pieces of image information 
reproduced by the reproducing means, wherein 
the piece of rank information includes ranks of 
the plurality pieces of link-target image informa- 
tion, wherein 

the rank setting means sets ranks of the m piec- 
es of image information based on the piece of 
rank information. 

20. The terminal apparatus of Claim 1 9 further compris- 
ing: 

deleting means for deleting, out of the identi- 
fiers of high* ranking s pieces of image information 
and t pieces of navigation information in the cache 
table, identifiers of pieces of image information and 
pieces of navigation information which have been 
stored in the cache means. 

21. The terminal apparatus of Claim 20. wherein 
the receiving means includes: 
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a receiving unit for receiving, out ol the s pieces 
of image information and t pieces ol navigation 
information with corresponding identifies regis- 
tered In the cache table, a piece of image infor- 
mation with a highest rank and a piece of nav- 
igation information corresponding to the piece 
of image information with the highest rank, 
wherein 

the terminal apparatus includes: 
data size judging means tor judging whether 
capacity of a tree area in the cache means ex- 
ceeds a data size ol the piece of image infor- 
mation with the highest rank and the piece of 
navigation information corresponding to the 
piece of image information with the highest 
rank; and 

writing means for writing the piece of image in- 
formation with the highest rank and the corre- 
sponding piece of navigation information into 
the free area when the data size judging means 
judges that the capacity of the free area ex- 
ceeds the data size of the piece of image infor- 
mation with the highest rank and the corre- 
sponding piece o! navigation information, 
wherein 

the receiving unit receives a piece of image in- 
formation with a second highest rank and a 
piece of navigation information corresponding 
to the piece of image information with the sec- 
ond highest rank alter the writing means writes 
the piece of image information with the highest 
rank and the corresponding piece ol navigation 
information into the free area. 

22. The terminal apparatus of Claim 21 . wherein 

the data size judging means includes: 
a frame size judging unit for. when the data size 
judging means judges that the capacity of the 
free area in the cache means does not exceed 
the data size of the piece of image information 
with the highest rank and the corresponding 
piece of navigation information, judging wheth- 
er the capacity of the free area in the cache 
means exceeds the data size of a frame of the 
piece of image information with the highest rank 
and a piece of navigation information corre- 
sponding to the piece of image information with 
the highest rank, wherein 
the writing means includes: 
a frame writing unit for writing the frame of the 
piece of image Information with the highest rank 
and the piece of navigation information corre- 
sponding to the piece of image information with 
the highest rank into the free area when the 
frame size judging unit judges that the capacity 
of the free area in the cache means exceeds 
the data size of the frame of the piece of image 
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information with the highest rank and the piece 
of navigation information corresponding to the 
piece of image information with the highest 
rank. 

23. The terminal apparatus of Claim 22, wherein. 

the data size judging means further includes: 
an oldest image information detecting unit for. 
out of the image information and the navigation 
information stored in the cache means, detect- 
ing a piece of oldest image information and a 
piece of oldest navigation information when the 
frame size judging unit judges that the capacity 
of the free area in the cache means does not 
exceed the data size of the frame of the piece 
of image information with the highest rank and 
the piece of navigation information correspond- 
ing to the piece of image information with the 
highest rank, wherein 

the frame writing unit overwrites the frame of 
the piece of image information with the highest 
rank and the corresponding piece of navigation 
information in an area in which the piece of old- 
est image information and the piece of oldest 
navigation information are stored. 

24. The terminal apparatus of Claim 20 further compris- 
ing: 
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rank information detecting means for detecting 
a piece or rank information from the piece of 
navigation information corresponding to the 
one out of the m pieces of image information 
reproduced by the reproducing means, wherein 
the piece of rank information includes ranks of 
the plurality pieces of link-target image informa- 
tion, wherein 

the rank setting means sets ranks of the m piec- 
es of image information based on the piece of 
rank information. 



25. A terminal apparatus for displaying an image by re- 
producing one out of m pieces of image information 
as and for interactively changing the image using n 
pieces of navigation information v/herein the image 
is one of a moving picture, a still picture, and a mix- 
ture of a moving picture and a stiit picture, wherein 
the m piec.es of image information and the n pieces 

so of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece ol navigation information is re- 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 

ss mation, wherein m and n are each an integer either 
of being equal to and larger than '1,* the terminal 
apparatus comprising: 
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reproducing means for reproducing the one out 
of the m pieces of image information; 
cache means for storing one out of the n pieces 
of navigation information which corresponds to 
the one out of the m pieces of image informa- 
tion; 

monitoring means for monitoring whether an 
operator has performed a certain operation re- 
sponding to the image displayed; 
first receiving means for, before the monitoring 
means determines that the operator has per- 
formed the certain operation, receiving, based 
on the piece of navigation information stored in 
the cache means, t pieces of navigation infor- 
mation which are respectively related to s piec- 
es of image information having possibility ol be- 
ing displayed, and storing the t pieces of navi- 
gation information in the cache means, wherein 
s is an integer satisfying 1:3s<m, and t is an 
integer satisfying 1^l<n: 
specifying means for specifying one out of the 
plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
performed the certain operation; 
identifying means for identifying apiece of nav- 
igation information corresponding to the one 
out of the plurality pieces ol link-target image 
information specified by the specifying means 
as one out ol the t pieces of navigation informa- 
tion stored in the cache means; and 
second receiving means for receiving the piece 
of link-target image information based on the 
piece ol navigation information in the cache 
means corresponding to the piece ol link-target 
image information specified by the specifying 
means, and storing the pieco of link-target im- 
age information in the cache means, wherein 
the reproducing means reproduces the piece ol 
link-target image information received by the 
second receiving means. 

26. The terminal apparatus of Claim 25 further compris- 
ing: 

superimposing means for superimposing, 
based on a piece of navigation information cor- 
responding to the one out of the m pieces of 
image information stored in the cache means, 
a plurality of icons on the image which is dis- 
played when the reproducing means reproduc- 
es the one out of the m pieces of image infor- 
mation, wherein 
the monitoring means includes: 
a determination operation detecting unit for de- 
tecting a determination operation performed on 
one out of the plurality of icons, wherein 
the identifying means identifies one out of the 
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plurality pieces of link-target image information 
detected by the determination operation detect- 
ing unit. 

27. The terminal apparatus of Claim 26 further compris- 
ing: 

default image reproducing means for, when the 
identifying means fails to identify the piece of 
navigation information in the cache means, re- 
producing a default image; and 
controlling means for instructing the first receiv- 
ing means to receive the piece of navigation in- 
formation when the piece of navigation informa- 
tion is not identified by the identifying means. 

28. The terminal apparatus of Claim 27, wherein 

the reproducing means includes: 
focus setting means for making one out of the 
plurality of icons be in focus, wherein 
the monitoring means includes: 
a cursor move operation detecting unit for de- 
tecting a cursor move operation; and 
a locus changing unit for making another one 
out of the plurality of icons be in focus based 
on the cursor move operation detected by the 
cursor move operation detecting unit, wherein 
the determination operation detecting unit de- 
tects a determination operation performed on 
the other one out of the plurality of icons in lo- 
cus. 



29. The terminal apparatus of Claim 26 further compris- 
35 ing: 

rank setting means tor setting ranks of the n 
pieces ol navigation information based on pos- 
sibility of being displayed; and 

40 cache table registering means for registering 

identifiers of high ranking t pieces of navigation 
information in a cache table, out of the n pieces 
of navigation information, wherein 
the receiving means receives the t pieces of 

45 navigation information specified by the identifi- 

ers registered in the cache table. 

30. The terminal apparatus of Claim 25 further compris- 
ing: 

weighting means for weighting, with a highest 
value, the one out of the plurality of icons made 
to be in focus by the focus setting means, and 
for weighting, with a second highest value, 
55 icons adjacent to the one in focus, wherein 

the rank setting means sets ranks of the n piec- 
es of navigation information based on values 
weighted by the weighting means. 
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31. The terminal apparatus of Claim 30 further compris- 
ing: 

deleting means (or deleting, out of the identi- 
fiers ot high ranking t pieces of navigation informa- 
tion in the cache table, identifiers of pieces of nav- 
igation information which have been stored in the 
cache means. 

32. The terminal apparatus of Claim 31. wherein 

the first receiving means includes: 

a receiving unit for receiving, out of the t pieces 

of navigation information with corresponding 

identifies registered in the cache table, a piece 

of navigation information with a highest rank. 

wherein 

the terminal apparatus includes: 
data size judging means tor judging whether 
capacily of a free area in the cache means ex- 
ceeds a data size of the piece of navigation in- 
formation with the highest rank; and 
writing means lor writing the piece of navigation 
information with the highest rank into the Iree 
area when the data size judging means judges 
that the capacily ol the free area exceeds the 
data size ol the piece ol navigation inlormation 
with the highest rank, wherein 
the receiving unit receives a piece of navigation 
information with a second highest rankatter ttie 
writing means writes the piece ol navigation in- 
formation with the highest rank into the Iree ar- 
ea. 



33. A terminal apparatus lor displaying an image by re- 
producing one out ot m pieces ol image inlormation 
and for interactively changing the image using n 
pieces ot navigation information wherein the image 
is one of a moving picture, a still picture, and a mix- 
ture of a moving picture and a still picture, wherein 
the m pieces of image information and the n pieces 
of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece of navigation information is re- 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than "1." Jhe terminal 
apparatus comprising: 

cache means for storing one out of the m pieces 
of image information; 

reproducing means for reproducing the one out 
of the m pieces ot image information stored in 
the cache means; 

monitoring means for monitoring whether an 
operator has performed a certain operation re- 
sponding to the image displayed; 
first receiving means for, before the monitoring 
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means determines that the operator has per- 
formed the certain operation, receiving, based 
on a piece ot navigation information corre- 
sponding to the one out of the m pieces of im- 
age information, s pieces of image information 
which have possibility of being displayed, and 
storing the s pieces of image information in the 
cache means, wherein s is an integer satisfying 
1 sas<m; 

specifying means for specifying one out of the 
plurality pieces ol link-target image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
performed the certain operation; 
identifying means for identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified by. Ihe specifying means as one 
out ol the s pieces ol image information stored 
in the cache means; and 
second receiving means for receiving the one 
out of the s pieces of image information from 
the cache means, wherein 
the reproducing means reproduces the one out 
ol the s pieces ol image information received 
by the second receiving means. 

34. The terminal apparatus of Claim 33 lurther compris- 
ing. 

superimposing means lor superimposing, 
based on a piece of navigation information cor- 
responding to the one out of the m pieces of 
image information stored in the cache means, 
a plurality of icons on the image which is dis- 
played when tho reproducing means reproduc- 
es the one out of the m pieces of image intor- 
mation, wherein 
the monitoring means includes: 
a determination operation detecting unit for de- 
tecting a determination operation performed on 
one out of the plurality of icons, wherein 
the identifying means identifies one out of the 
plurality pieces of link-target image information 
detected by the determination operation detect- 
ing unit. 

35. The terminal apparatus of Claim 34 further compris- 
ing: 

default image reproducing means lor, when the 
identifying means fails to identify the piece of 
image information in the cache means, repro- 
ducing a default image; and 
controlling means for instructing the first receiv- 
ing means to receive the piece of image infor- 
mation when the piece of image Information is 
not identified by the identifying means. 
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36^ The terminal apparatus of Claim 35. wherein 

the reproducing means includes: 
focus setting means tor making one out of the 
plurality of icons be in focus, wherein 
the monitoring means includes: . 
a cursor move operation detecting unit for de- 
tecting a cursor move operation; and 
a focus changing unit for making another one 
out of the plurality ol icons be in focus based 
on the cursor move operation detected by the 
cursor move operation detecting unit, wherein 
the determination operation detecting unit de- 
tects a determination operation performed on 
the other one out of the plurality of icons in fo- 
cus. 

37. The terminal apparatus ol Claim 34 further compris- 
ing: 

rank setting means for setting ranks ol the m 
pieces of image information based on possibil- 
ity of being displayed: and 
cache table registering means (or registering 
identiliers ol high ranking s pieces of image in- 
formation in a cache table, out ol the m pieces 
of image inlormation. wherein 
the receiving means receives the s pieces ol 
imago information specified by the identifiers 
registered in the cache table. 

38. The terminal apparatus ol Claim 33 lurther compris- 
ing: 

weighting means lor weighting, with a highest 
va!uo : the one out or the plurality of icons made 
to be in focus by the focus setting means, and 
for weighting, with a second highest value, 
icons adjacent to the one in focus, wherein 
the rank setting means sets ranks of the m piec- 
es of image information based on values 
weighted by the weighting means. 

39. The terminal apparatus ol Claim 33 further compris- 
ing: 

deleting means lor deleting, out of the identi- 
fiers of high ranking s pieces ol image information 
in the cache table, identifiers of pieces of image in- 
formation which have bean stored in the cache 
means. 

40. The terminal apparatus of Claim 39. wherein 



the first receiving means includes: 
a receiving unit tor receiving, out of the s pieces 
of image information with corresponding iden- 
tifies registered in the cache table, a piece of 
image information with a highest rank, wherein 



the terminal apparatus includes: 
data size judging means for judging whether 
capacity of a free area in the cache means ex- 
ceeds a data size of the piece of image infor- 
s mation with the highest rank; and 

writing means for writing the piece of image in- 
formation with the highest rank Into the free ar- 
ea when the data size judging means judges 
that the capacity of the free area exceeds the 
io data size of the piece of image information with 

the highest rank, wherein 
the receiving unit receives a piece of image in- 
formation with a second highest rank after the 
writing means writes the piece of image inf or- 
is mation with the highest rank into the tree area. 

41. A terminal apparatus for displaying an image by re- 
producing one out ol m pieces of image information 
and for interactively changing the image using n 
20 pieces of navigation information, wherein the image 
is cne ol a moving picture, a still picture, and a mix- 
ture ol a moving picture and a still picture, wherein 
the m pieces of image information and the n pieces 
ol navigation inlormation together are broadcast by 
25 a broadcasting station to the terminal apparatus, 
wherein each piece ol navigation inlormation is re- 
lated to an origin piece ol image inlormation and in- 
dicates a plurality pieces ol link-target image infor- 
mation, wherein m and n are each an integer either 
jo of being equal to and larger than M t * the terminal 
apparatus including: 



cache means lor storing a pair of one out ol the 
m pieces of image inlormation and one out of 
3S the n pieces of navigation information; 

reproducing means for reproducing the one out 
ol the rn pieces of image information stored in 
the cache means; 

monitoring means for monitoring whether an 
40 operator has performed a certain operation re- 

sponding to the image displayed; 
receiving means for, before the monitoring 
means determines that the operator has per- 
formed the certain operation, receiving s pieces 
4S of image information which have possibility of 

being displayed and t pieces of navigation In- 
formation respectively related to the s pieces of 
image information based on the one out of the 
n pieces of navigation information stored in the 
so cache means, and storing the s pieces of image 

information and the t pieces of navigation infor- 
mation in the cache means, wherein s is an in- 
teger satisfying 1 s*s<m, and t is an integer sat- 
isfying is;t<n; 

55 specifying means for specifying one out of the 

plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
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performed the certain operation; 
identifying means for identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified by the specifying means as one 
out the s pieces of image information stored in $ 
the cache means; 

first controlling means for reading the piece ol 
link-target image information identified by the 
identifying means and instructing the reproduc- 
ing means to reproduce the piece of link-target 
image information, and instructing the receiving 
means to receive other s pieces of image infor- 
mation and other t pieces ol navigation infor- 
mation based on one out of the t pieces of nav- 
igation information in the cache means corre- 
sponding to the piece ol link-target image infor- 
mation identilied by the identifying means; 
rank setting means lor setting ranks of the m 
pieces ol image information stored in the cache 
means based on possibility ol being displayed; & 
and 

cache table registering means lor registering 
identifiers ol high ranking s pieces of image in- 
formation in a cache table, out of the m pieces 
of image information and registering identifiers » 
of I pieces of navigation information corre- 
sponding to the high ranking s pieces ol image 
information, wherein 

the receiving means receives the s pieces of 
imago information whose identifiers are regis- M 
tered by the cache table registering means and 
receives I pieces of navigation information cor- 
responding to the s pieces of image informa- 
tion. 

35 

42. A terminal apparatus lor displaying an image by re- 
producing one out of m pieces of image information 
and for interactively changing the imago using n 
pieces ol navigation information, wherein the image 
is one of a moving picture, a still picture, and a mix- ■« 
turo of a moving picture and a still picture, wherein 
tho m pieces ol image information and the n pieces 
of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece ol navigation information is re- 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than "I," the terminal 
apparatus including: 

cache means for storing a pair of ono out of the 
m pieces of image information and one out of 
the n pieces ol navigation information; 
reproducing means for reproducing the one out ss 
of the m pieces ol image information stored in 
the cache means; 

monitoring means for monitoring whether an 



operator has performed a certain operation re- 
sponding to the image displayed: 
receiving means for. before the monitoring 
means determines that the operator has per- 
formed the certain operation, receiving s pieces 
of image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces of 
image information based on the one out of the 
n pieces of navigation information stored in the 
cache means, and storing the s pieces of image 
information and the I pieces of navigation infor- 
mation in the cache means, wherein s is an in- 
teger satisfying 1 Ss<m, and t is an integer sat- 
isfying 1^t<n; 

specifying means for specifying one out of the 
plurality pieces ol link-target image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
performed the certain operation; 
identifying means for identifying the one out of 
the plurality pieces ol link-target image informa- 
tion specified by the specifying means as one 
out the s pieces of image information stored in 
the cache means; 

first controlling means for reading the piece of 
link-target image information identified by the 
identilying means and instructing the reproduc- 
ing means to reproduce the piece of link-target 
image information, and instructing the receiving 
means to receive other s pieces ol image infor- 
mation and other t pieces ol navigation infor- 
mation based on one out of the t pieces ol nav- 
igation information in the cache means corre- 
sponding to the piece of link-target image infor- 
mation identified by the identifying means; 
superimposing means for superimposing, 
based on a piece of navigation information cor- 
responding to the one out of the m pieces of 
image information stored in the cache means, 
a plurality of icons on the image which is dis- 
played when the reproducing means reproduc- 
es the one out of the m pieces of image Infor- 
mation; 

rank setting means for setting ranks ol the m 
pieces ol image information stored In the cache 
means based on possibility of being displayed; 
cache table registering means for registering 
Identifiers of high ranking s pieces of image In- 
formation in a cache table, out of the m pieces 
of image information and registering identifiers 
of t pieces ol navigation information corre- 
sponding to the high ranking s pieces of image 
information; and 

weighting means for weighting, with a highest 
value, the one out of the plurality of Icons made 
to be in focus by the focus setting means, and 
for weighting, v/ith a second highest value. 
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icons adjacent to the one in focus, wherein 
the reproducing means includes: 

focus setting means for making one out 
of the plurality of icons be in focus, wherein 
the monitoring means includes: 

a determination operation detecting unit (or 
detecting a determination operation per- 
formed on one out of the plurality of icons; 
a cursor move operation detecting unit (or 
detecting a cursor move operation; and 
a focus changing unit for making another 
one out of the plurality of icons be in focus 
based on the cursor move operation de- 
tected by the cursor move operation de- 
lecting unit, wherein 
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the identifying means identifies one out or the 
plurality pieces of link-target image information 
detected by the determination operation delect- *° 
ing unit, wherein 

the determination operation delecting unit de- 
tects a determination operation performed on 

the other one out ol the plurality ol icons in to- 
rs 

cus, wherein 

the receiving means receives the s pieces of 
image inlormalion whose identiliers are regis- 
tered by Ihe cache table registering means and 
receives I pieces of navigation information cor- 
responding to the s pieces of image informa- 30 
lion, and wherein 

the rank setting means sets ranks of the m piec- 
es of image information based on values 
weighted by the weighting means. 

A terminal apparatus lor displaying an image by re- 
producing one out of m pieces of image information 
and for interactively changing the image using n 
pieces of navigation information, wherein the image 
is one of a moving picture, a still picture, and a mix- *o 
ture-ot a moving picture and a still picture, wherein 
the m pieces of image information and the n pieces 
of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece of navigation information is re- < s 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than M," the terminal 
apparatus including: 

cache means for storing a pair of one out of the 
m pieces ol image information and one out of 
the n pieces of navigation information; 
reproducing means for reproducing the one out ss 
of the m pieces of image information stored in 
the cache means: 

monitoring means for monitoring whether an 



operator has performed a certain operation re- 
sponding to the image displayed: 
receiving means for. before the monitoring 
maans determines that the operator has per- 
formed the certain operation, receiving s pieces 
of image Information which have possibility of . 
being displayed and t pieces of navigation In- 
formation respectively related to the s pieces of 
image information based on the one out of the 
n pieces of navigation information stored in the 
cache means, and storing the s pieces ol image 
information and the t pieces of navigation infor- 
mation in the cache means, wherein s Is an In- 
teger satisfying 1 ss<m. and t is an integer sat- 
isfying '\zzi<(\; 

specifying means for specifying one out or the 
plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
performed the certain operation; 
identifying means for identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified by the specifying means as one 
out the s pieces of image information stored in 
Lhs cache means; 

first controlling means for reading the piece of 
Imk-targel image information identified by the 
identifying means and instructing the reproduc- 
ing means to reproduce the. piece of link-target 
image information, and instructing the receiving 
means to receive other s pieces of image infor- 
mation and other t pieces of navigation infor- 
mation based on one out of the t pieces of nav- 
igation information in the cache means corre- 
sponding to the piece of link-target image infor- 
mation identified by the identifying means; 
superimposing means tor superimposing, 
based on a piece of navigation information cor- ■ 
responding to the one out of the m pieces of 
image information stored in the cache means, 
a plurality of icons on the image which Is dis- 
played when the reproducing means reproduc- 
es the one out of the m pieces of image infor- 
mation; 

rank setting means for setting ranks of the m 
pieces ol image information stored in the cache 
means based on possibility of being displayed; 
cache table registering means for registering 
identifiers of high ranking s piaces of Image in- 
formation in a cache table, out of the m pieces 
of image information and registering identifiers 
cl t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 
information; and 

deleting means for deleting, out of the identifi- 
ers of high ranking s pieces of image informa- 
tion and t pieces of navigation information in the 
cache table, identifiers of pieces of image Infor- 
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mation and pieces of navigation information 
which have been stored in the cache means, 
wherein 

the monitoring means includes: 

a determination operation detecting unit 
tor detecting a determination operation per- 
formed on one out of the plurality of icons, 
wherein 

the identifying means identifies one out of the 
plurality pieces of link-target image information 
detected by the determination operation detect- 
ing unit, wherein 

the receiving means receives the s pieces of 
image information whose identifiers are regis- 
tered by the cache table registering means and 
receives I pieces of navigation information cor- 
responding to the s pieces of image informa- 
tion. 

44. A terminal apparatus tor displaying an image by re- 
producing one out ol m pieces ol image information 
and for interactively changing the image using n 
pieces of navigation information, wherein the image 
is one of a moving picture, a still picture, and a mix- 
ture ol a moving picture and a still picture, wherein 
the m pieces ol image information and the n pieces 
of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece of navigation information is re- 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than "1." the terminal 
apparatus including: 

cache means for storing a pair of one out of the 
m pieces of image information and one out of 
the n pieces ol navigation information; 
reproducing means for reproducing the one out 
of the m pieces of image information stored in 
tho'cache means: 

monitoring means for monitoring whether an 
operator has performed a certain operation re- 
sponding to the image displayed; 
receiving means tor, before the monitoring 
means determines that the operator has per- 
formed the certain operation, raceiving s pieces 
of image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces of 
image information based on the one out of the 
n pieces of navigation information stored in the 
cache means, and storing the s pieces of image 
information and the t pieces of navigation Infor- 
mation in the cache means, wherein s is an in- 
teger satisfying ts;s<m, and t is an integer sat- 
isfying 1 s;t<n; 

specifying means for specifying one out of the 
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plurality pieces of link-targat image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
performed the certain operation; 
identifying means for identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified by the specifying means as one 
out the s pieces of image information stored in 
the cache means; 

first controlling means for reading the piece of 
link-target image information identified by the 
identilytng means and instructing the reproduc- 
ing means to reproduce the piece of link-target 
image information, and instructing the receiving 
means to receive other s pieces of image infor- 
mation and other t pieces of navigation infor- 
mation based on one out of the t pieces of nav- 
igation information in the cache means corre- 
sponding to the piece of link-target image infor- 
mation identified by the identifying means; 
superimposing means for superimposing, 
based on a piece of navigation information cor- 
responding to the one out of the m pieces of 
image information stored in the cache means, 
a plurality of icons on the image which is dis- 
played when the reproducing means reproduc- 
es the one out of the m pieces of image infor- 
mation; 

rank setting means for setting ranks of the m 
pieces ol image information stored in the cache 
means based on possibility of being displayed; 
cache table registering means for registering 
identifiers of^high ranking s pieces of image in- 
formation in a cache table, out of the m pieces 
of image information and registering identifiers 
of t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 
information; and 

rank information detecting means for detecting 
a piece of rank information from the piece of 
navigation information corresponding to the 
one out of the m pieces of image information 
reproduced by the reproducing means, wherein 
the piece of rank information includes ranks of 
the plurality pieces of link-target image informa- 
tion, wherein 

the monitoring means includas: 

a determination operation detecting unit 
for detecting a determination operation per- 
formed on one out of the plurality of icons, 
wherein 

the identifying means identifies one out of the 
plurality pieces ol link-target image information 
detected by the determination operation detect- 
ing unit, wherein 

the receiving means receives the s pieces of 
image information whose identifiers are regis- 
tered by the cache table registering means and 
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receives t pieces of navigation information cor- 
responding to the s pieces of image informa- 
tion, and v/herein 

the rank setting means sets ranks of the m piec- 
es of image information based on the piece of 
rank information. 

45: A reproduction method used in a terminal apparatus 
for displaying an image by reproducing one out of 
m pieces of image information and for interactively 
changing the imag9 using n pieces of navigation in- 
formation wherein the image is one of a moving pic- 
ture, a still picture, and a mixture of a moving picture 
and a still picture, wherein the m pieces of image 
information and the n pieces of navigation informa- 
tion together are broadcast by a broadcasting sta- 
tion to the terminal apparatus, wherein each piece 
of navigation information is related to an origin piece 
of image information and indicates a plurality pieces 
of link-target image information, wherein m and n 
are each an integer either of being equal to and larg- 
er than "1.* the terminal apparatus comprising: 

cache means for storing a pair of one out of the 
m pieces ol image inlormation and one out ol 
the n pieces of navigation information, wherein 
the reproduction method comprising: 
a reproducing step of reproducing the one out 
of the m pieces of image information stored in 
the cache means, 

a monitoring step of monitoring whether an op- 
erator has performed a certain operation re- 
sponding to the image displayed; 
a receiving step of. before it is determined in 
the monitoring step that the operator has per- 
formed the certain operation, receiving s pieces 
of image information which have possibility of 
being displayed and I pieces of navigation in- 
formation respectively related to the s pieces of 
image information based on the one out of the 
n pieces of navigation information stored in the 
cache means, and storing the s pieces of image 
information and the t pieces of navigation infor- 
mation in the cache means, wherein s is an In- 
teger satisfying 1 Ss<m, and t is an integer sat- 
isfying 1£t<n; 

a specifying step of specifying one out of the 
plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring step monitors that the operator has per- 
formed the certain operation; 
an identifying step of identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified in the specifying step as one out 
the s pieces of image information stored in the 
cache means; and 

a first controlling step of reading the piece of 
link-target image information identified in the 
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identifying step and instructing the reproducing 
step to reproduce the piece of link-target image 
information, and instructing the receiving step 
to receive other s pieces of image information 
and other t pieces ol navigation information 
based on one out of the t pieces of navigation 
information in the cache means corresponding 
to the piece of link-target image information 
identified in the identifying step. 

46. The reproduction method of Claim 45 further com- 
prising: 

a superimposing step of superimposing, based 
on a piece of navigation information corre- 
sponding to the one out of the m pieces of im- 
age information stored in the cache means, a 
plurality of icons on the image which is dis- 
played when the one out of the m pieces of im- 
age information is reproduced in the reproduc- 
ing step, wherein 
the monitoring step includes: 
a determination operation detecting sub-step of 
detecting a determination operation performed 
on one out ol the plurality of icons, wherein 
in the identifying step, one out of the plurality 
pieces of link-target image information detect- 
ed by the determination operation detecting 
unit is identified. 

47. The reproduction method of Claim 46 further com- 
prising: 

a default image reproducing step of, when the 
identifying step fails to identify the one out of 
the plurality pieces of link-target image informa- 
tion specified in the specifying step, reproduc- 
ing a default image; and 
a second controlling step of instructing the re- 
ceiving step to receive the piece of link-target 
image information specified in the specifying 
step when the piece of link-target image infor- 
mation is not Identified in the identifying step, 
and to receive a piece of navigation information 
corresponding to the piece of link-target image 
information specified in the specifying step, and 
storing the received piece of link-target image 
information and the corresponding piece of 
navigation information in the cache means, 
wherein 

in the superimposing step, a plurality of icons 
are superimposed on the image based on the 
piece of navigation information received in the 
receiving step. 

48. The reproduction method of Claim 46, wherein 

the reproducing step includes: 
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a focus setting step of making one out of the 
plurality of icons be in locus, wherein 
the monitoring step includes: 
a cursor move operation detecting sub-step of 
detecting a cursor move operation; and 
a focus changing sub-step of making another 
one out ol the plurality of icons be in focus 
based on the cursor move operation detected 
in the cursor move operation detecting sub- 
step, wherein 

in the determination operation detecting sub- 
step, a determination operation performed on 
the other one out of the plurality of icons In fo- 
cus is detected. 

49. The reproduction method of Claim 45 further com- 
prising: 



a rank setting step ol selling ranks of the m 
pieces ol image information stored in the cache *° 
means based on possibility ol being displayed; 
and 

a cache table registering step ol registering 
identifiers ol high ranking s pieces of image in- 
formation in a cache table, out ol the m pieces 2S 
of image information and registering identifiers 
of I pieces ol navigation information corre- 
sponding to the high ranking s pieces ol image 
information, wherein 

in the receiving step, the s pieces of image in- so 
formation whose identiliers are registered in the 
cache table reqisterinq step are received and I 
pieces ol navigation information corresponding 
to the s pieces of image information are re- 
ceived. 35 

50. The reproduction method of Claim 49 further com- 
prising. 

a weighting step of weighting, with a highest ^ 
value, the one out of the plurality of Icons made 
to be in focus in the focus setting step, and for 
weighting, with a second highest value, Icons 
adjacent to the one in focus, wherein 
in the rank setting step, ranks of the m pieces 
of image information are set based on values 
weighted in the weighting step. 



51. The reproduction method of Claim 50 further com- 
prising: 

a deleting step of deleting, out of the Identifi- 
ers of high ranking s pieces of image information 
and t pieces of navigation information in the cache 
table, identifiers ol pieces of image information and 
pieces of navigation information which have been 
stored in the cache means. 

52. A record medium in which a reproduction program 
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is recorded, the reproduction program being used 
in a terminal apparatus for displaying an image by 
reproducing one out of m pieces of image informa- 
tion and for interactively changing the image using 
n pieces of navigation information wherein the inv 
age is one of a moving picture, a still picture, and a 
mixture of a moving picture and a still picture, 
wherein the m pieces of image information and the 
n pieces of navigation information together are 
broadcast by a broadcasting station to the terminal 
apparatus, wherein each piece of navigation infor- 
mation is related to an origin piece of image infor- 
mation and indicates a plurality pieces of link-target 
image information, wherein m and n are each an 
integer either ol being equal to and larger than M," 
Ihe terminal apparatus comprising: 

cache means lor storing a pair of one out ol the 
m pieces of image information and one out of 
the n pieces of navigation information, wherein 
the reproduction program comprising: 
a reproducing step of reproducing the one out 
ol the m pieces ol image information stored in 
the cache means; 

a monitoring step of monitoring whether an op- 
erator has performed a certain operation re- 
sponding to the image displayed: 
a receiving step of. before it is determined in 
the monitoring step that the operator has per- 
formed the certain operation, receiving s pieces 
ol image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces of 
image information based on the one out of the 
n pieces of navigation information stored in the 
cache means, and storing the s pieces ol image 
information and the t pieces of navigation infor- 
mation in the cache means, wherein s is an in- 
teger satisfying 1 Ss<m, and t is an integer sat- 
isfying 1 St<n; 

a specifying step of specifying one out of the 
plurality pieces ol link-target image information 
based on the certain operation when the mon- 
itoring step monitors that the operator has per- 
formed the certain operation: 
an identifying step of identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified in the specifying step as one out 
the s pieces of image information stored in the 
cache means; and 

a first controlling step of reading the piece of 
link-target image information identified In the 
identilying step and instructing the reproducing 
step to reproduce the piece of link-target image 
information, and instructing the receiving step 
to receive other s pieces of image information 
and other t pieces of navigation information 
based on one out of the t pieces of navigation 
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information in the cacha means corresponding 
to the piece ol link-target image information 
identified in the identifying step. 

53. The record medium of Claim 52. wherein 

the reproduction program further comprises: 
a superimposing step of superimposing, based 
on a piece of navigation information corre- 
sponding to the one out of the m pieces of im- 
age information stored in the cache means, a 
plurality of icons on the image which is dis- 
played when the one out of the m pieces of im- 
age information is reproduced in the reproduc- 
ing step, wherein 
the monitoring step includes: 
a determination operation detecting sub-step of 
detecting a determination operation performed 
on one out of the plurality o( icons, wherein 
in the identilying step, one out ol the plurality 
pieces of link-target image information delect- 
ed by the determination operation detecting 
unit is identified. 

54. The record medium of Claim 53, wherein 

the reproduction program further comprises: 
a default image reproducing step ol, when the 
identifying step fails to identify the. one out of 
the plurality pieces ol link-target image informa- 
tion specified in the specifying step, reproduc- 
ing a default image; and 
a second controlling step of instructing the re- 
ceiving step to receive the piece of link-target 
imago information specified in the specifying 
step when the piece of link-target image infor- 
mation is not identified in the identifying step, 
and to receive a piece of navigation information 
corresponding to the piece of link-target Image 
information specified in the specifying step, and 
storing the received piece of link- target image 
information and the corresponding piece of 
navigation information in the cache means, 
wherein 

in the superimposing step, a plurality of Icons 
are superimposed on the image based on the 
piece of navigation information received In the 
receiving step. 

55. The record medium of Claim 53, wherein 

the reproducing step includes: 

a focus serving step of making one out of the 

plurality of icons be in focus, wherein 

the monitoring step includes: 

a cursor move operation detecting sub-step of 

detecting a cursor move operation; and 

a focus changing sub-step of making another 



one out of the plurality of icons be In focus 
based on the cursor move operation detected 
in the cursor move operation detecting sub- 
step, wherein 

5 in the determination operation detecting sub- 

step, a determination operation performed on 
the other one out of the plurality of icons In fo- 
cus is detected. 

io 56. The record medium of Claim 52, wherein 



the reproduction program further comprises: 
a rank setting step of setting ranks of the m 
pieces of image information stored in the cache 
is means based on possibility of being displayed: 

and 

a cache table registering step of registering 
identifiers of high ranking s pieces of image in- 
formation in a cache table, out of the m pieces 
20 ol image information and registering identifiers 

of t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 
information, wherein 

in the receiving step, the s pieces of image in- 
25 formation whose identifiers are registered in the 

cache table registering step are received and t 
pieces of navigation information corresponding 
to the s pieces ol image information are re- . 
ceived. 

30 

57. The record medium of Claim 56. wherein 

the reproduction program lurther comprises: 
a weighting step of weighting, with a highest 
ys value, the one out of the plurality of icons made 

to be in focus in the focus setting step, and for 
weighting, with a second highest value, icons 
adjacent to the one in focus, wherein 
in the rank setting step, ranks of the m pieces 
40 of image information are set based on values 

weighted in the weighting step. 

58. The record medium of Claim 57, wherein 

4s the reproduction program further comprises: 

a deleting step ol deleting, out of the Identifiers 
ol high ranking s pieces of Image Information 
and t pieces of navigation information In the 
cache table, identifiers of pieces of image infor- 
so mation and pieces of navigation information 

which have been stored in the cache means. 
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FIG. 2A 



NARRA TION INCLUDED IN AUDIO ELEMENT [lj (PIP = 0x060 1 ) 

INTRODUCING INTERACTIVE CHANNEL. 
THANK YOU FOR SELECTING THE "A" BROADCAST. 
FOR TODAY S BROADCAST.WE WILL BE SHOWING 
THE FOLLOWING PROGRAMS. WE ARE SURE YOU 
WILL ENJ OY THEM. 

MOTION PICTURE INCLUDED IN VIDEO ELEMENT[l)(PID=OX202) 

SHOT 0? A BROADCASTING COMPANY ANNOUNCER(120 SECONDS) 
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FIG. 2B 



NARRATION INCLUDED IN AUDIO ELEMENT[2](PID=Ox0602) 



NEW MOVIE INFORMATION. 
COMING UP SOON AT THEATERS IN OSAKA. 



MOTION PICTURE INCLUDED IN VIDEO ELEMENT[2](PID=0X302) 
PR EVIEW OF NEW MOVI£S(360 SECONDS) 

FIRST FRAME(00:00:00,OOSECVV 
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FIG. 2C 

NARRATION INCLUDED IN AUDIO ELEMENT[12] 
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FIG. 2D 



NARRATION INCLUDED IN AUDIO ELEMENT [43] 



INTRODUCING THE CAST OF "THE TERROR OF THE HUGE 
TORNADO' (DISTRIBUTED BY AAA COMPANY). 
PLEASE SELECT AN ACTOR/ACTRESS. 

MOTION PICTURE INCLUDED IN VIDEO ELEMENT(43] 

SHOTS OF THE MAIN CAST OF "THE TERROR OF THE HUGE TORNADO 
DISTRIBUTED BY AAA COMPANY 




37 



EP 0 B27 340 A2 



r 



FIG. 3 

nvt[i] ; 

Object Definition Table 



Index 



1 

2 
3 
4 



Button 
Button 
Button 
Button 



safest 



50 
100 

50 
100 



50 
50 
100 
100 



HANDLER 



2 



HD Index' 
HQ Index 
HD !nd?xl3 
HD Index 



4! 



NormaLBitrc? 



bitmap! 
bitmap2 
bitmap3 
bitmap4 



:orc::id_3itmap 



bitmaplOl 
bitmapl02 
bitmapl03 
bitmapl04 



302 



HDJndex 


Script 


1 
2 
3 
4 


goto_content(HL_indexl) 
goto_content(HL_index2) 
goto_content(HL_index3| 
goto_content(HL_index4) 



303 



H yperlink Table 
cri^n\y_ai;5.ai\ ; E_ROdlVE.e < ent.id 



fl .conp. 

0x0002 
0x0003 
0x0004 
0x0005 



Cjac.id |A£_cvectlc Aij 



^304 










\E_y*jd|NS_:WMj(i 


NE.id.LXT 


raft 


0x0102 






0x0X2 


1 


0x0103 






0x(X03 


2 


0x0104 






0x0C04 


3 


0x0105 






OxCOOS 


4 



Bitmap Table 
bitmap 1 

bitmap4 

mm 



biimaplOl 



301 



bitmap2 



bitmap3 

V£N i ?mation) 





bitmap 102 



bitmapl03 






bitmap 104 




EP 0 827 340 A2 



FIG. 4 



NVT[2] 



Index 


type 


A- 


\- 


HANDLER 


Nlamaljiicrep 


forcusjd.Bitnap 


1 
2 
3 
4 


Buuon 
Button 
Button 
Button 


75 
125 
100 
150 


50 
50 
100 
120 


HD lndexll 
HD lnc«!2 
HD Index 3] 
HD Index(4j 


bitmapl 
bitmap2 
bitmap3 
bitmap4 


bitrr.apl05 
bitmap 106 
bitmapl07 
bitmap 108 



Handler Definition Table 



HDJndex 


Script 


1 

2 

3 
i 

4 


goto.cnntent(HLjndexl) 
goto„content(HLjndex2) 
goto _content(H Ljndex3) 
gotoj:ontent(HL_index4) 



Hyperlink Table 



KL.Wa 




ts_id 


^E_svc_i<! 


VEj-.Bitjd 


VE.ccirpJag 




r 1 £j.ail.id 


AEjonfjsg 




NEjvailjd 


.VbjOXi 


rank 


1 
2 
3 
4 










GxOOll 
0x0012 
Cx002l 
OxOCOl 






CxCOlll 
CxOG I I 2 
0x00121 - 
CxOOlOl 






ill! 


1 
2 
3 
4 



Bitmap Table 

bitmapS 



/THE TERROR OF THE HUGETO&NAUU \ (™1 
" ^DISTRIBUTED BY AAA COMPANY) ) lOMHISM 



bitmaps 

RETURN CF THE MtMIRUOS \ 
Iff (KSMUTED BY BEB COMPANY J 



bitmap7 



bitmap8 



(SPORTS WARS(DISTRIBUTED \ I RETURN^ 
yBY AAA COMPANY) ) V KCAU ^ V 



bitmapl 05 



bitmap!06 




bitmaplO? 



bitmap!08 






39 



EP 0 827 340 A2 



NVT[12] 

Object Definition Table 



FIG. 5 



Index 


type 


V 

C-X&2! 


m 


HANDLER 


1 


Button 


25 


25 


HD tod«[l 




2 


Button 


75 


25 


HD_lndex!2 




3 


Button 


25 


50 


HD Ir.dexpi 
HDJndBfl 


4 


Button 


75 


50 




Button 


25 


75 


rDJndexlS 




6 


Button 


25 


100 


■O lr.dex'6 




7 


Button 


75 


100 


-D IfidexiT 




8 


Button 


25 


125 


© Index's 




g 


Button 


75 


125 


4D Ir.dex;9j 


10 


Button 


ICO 


125 


4D>.dex[lG| 



Nortril.Eitep 



bionap4 1 

bkmap42 

bicmap43 

bitinap44 

bicmap45 

bior»3p46 

bitrr.ap47 

bitrr.ap48 

bitmap49 

bitmapSO 



rcrcjsed.BisncO 



bitmapl41 
bitmap 1 42 
bitmap 1 43 
bit:napl44 
bitmapl45 
bitmap 1 45 
bitmap 1 47 
bitmap 1 48 
bitmapl49 
bitmap 1 50 



Handler Definition Table 



HD.lndcx 


Script 


1 


goto. 


_content(HL_indexl) 


2 


goto. 


_content(HL_index2) 


3 


goto. 


lcontent(HLjndex3) 


4 


goto. 


„content(HL_index4) 



Hyperlink Table 



IL Wa 



CIBCV 



1 

2 
3 
4 
5 
6 

•7 

8 
9 

10 



Bitmap Table 



bid 



il Stic 



VEjwb jd VEcoirpJzg 



0x0041 
0x0042 
0x9043 
0x0044 
0x0045 
0x0046 
0x0047 

OxiXKS 
Ox004S 



ri e.st i 





NE.scjd 


\E_evatjd 




rar.li 


0x0141 






0xG041 


7 


0x0142 






0x0042 


6 


0x9143 






OxOC43 


4! 


0x0144 






OxOC44 


5 


0x0145 






GxOC45 


1 


0x9145 






GxOC45 


3 


0x9147 






GxOC47 


2 


0x0143 






OxOC43 


8 


0x0149 






0x0049 


9 


0x9150 




0x0050 


10 



Bitmap41 ( opening ) 



Bitmap45 (wikji.i-: town in I'anic 
Bitmap48 ( climax ) 
Bitm2p4 4 (weather report) 



Bi;m£p49 ( endinc 



Bitmap43 (btoivceof the entire cast) 
") Bitmap46 (WiiA'niKRKi-K)in' } 
Bitrnap42 (stornun x state) 
Bitmap47 (Trft biccgtto^o s iicncmt pffBflre) 
BitmapSO (return) 



40 



Program Map Table 



table_id=0x02 

program_number= 0x0001 
PCR_PID= 0x0081 



"FID" 

0x0302 
0x0303 
0x0304 
0x0305 

• 
• 

0x0401 
0x0402 
0x0403 

* 
• 

9x0601 
0x0602 
0x0603 
0x0604 
0x0605 
0x0606 



stream_type 



descriptor 

stream _identifier_descritor 
stream_identifier_descritor 
! stream Jdentif ier_descritor 
stream_identifier_descritor 

* 

stream _identifier_descritor 
stream_identifier_descritor 
stream_identifier_descritor 



stream, 
stream, 
stream, 
stream, 
stream, 
stream. 



.identifier, 
.identifier, 
.identifier, 
.identifier, 
.identifier 
identifier 



descritor 
descritor 
descritor 
.descritor 
.descritor 
descritor 



component_tag0x0002 
component jag0x0003 
component_tag0x0004 
component_tag0x0005 

componenLtagOxOO 1 i 
componenLtagOxOO 1 2 
component_tag0x002 1 



component, 
component, 
component, 
component, 
component, 
component. 



tagOxOlOl 
tag0x0102 
.tag0x0103 
.tag0x0104 
tag0x0105 
tag0x0106 



EP 0 B27 340 A2 




43 



EP 0 827 340 A2 



FIG. 8B 



I 



POWER 



c 



( 



c 



1 


2 


CO 


4 


5 


6 


7 


8 


9 


0 


+10 


+100 





A 


1 

• 


CLEAR 


< ■ 


* 






T 




ENTER 



idt] nun 



44 



EP 0 827 340 A2 




45 



EP 0 827 340 A2 



FIG. 10A 



NAVIGATION CACHE UNIT 





NVT 


DISPLAY HISTORY MARK 


1 


NVT[1] 


©HIT 


2 


NVT [2] 


NOT JUDGED 


3 


NVT [31 


NOT JUDGED 


4 


NVT[4j 


NOT JUDGED 


5 


NVT15] 


NOT JUDGED . 


1 ° B NAVIGATION CACHE UNIT 




NVT 


DISPLAY HISTORY MARK 


1 


NVTU1 


•HIT 


2 


NVT12] 


•HIT 


3 


NVT[3] 


MISSED 


4 


NVT[4) 


MISSED 


5 


NVT15J 


MISSED 


IOC 

NAVIGATION CACHE UNIT 




NVT 


DISPLAY HISTORY MARK 


1 


NVT[1] 


•HIT 


2 


NVT[2J 


•HIT 


3 


FREE AREA 


4 


• FREE AREA 


5 


FREE AREA 



FIG. 10D 



NAVIGATION CACHE UNIT 



1 


NVT 1 
NVTHJ 

M\/Tf9l 


DISPLAY HISTORY MARK 
•HIT 
•HIT 


'/> 3 V// 


»NVT[llj 




/XNOTJUDGED/X 
///NOT JUDGED 


% 4 '/// 
/// 5 '/// 


//NVT[12] 
»NVT[21J 


1 


X/, NOT JUDGED >y 



46 



EP 0 827 340 A2 



FIG. 10E 



NAVIGATION CACHE UNIT 





NVT 


DISPLAY HISTORY MARX 


1 


NVT[1] 


©HIT 


2 


NVT12J 


©HIT 


3 


NVT111J 


MISSED 


4 


NVT 1 12] 


©HIT 


5 


NVT [2 1| 


MISSED 



FIG. 10F 



NAVIGATION CACHE UNIT 





NVT 


DISPLAY HISTORY MARK 


1 


NVTIU 


©HIT 


2 


NVT 12] 


©HIT 


3 


NVT[12j 


©HIT 


4 


FREE AREA. 


5 


FREE AREA 



FIG. 10G NAVIGATI0 N CACHE UNIT 



zz 



7ZH 



7. 



NVT [12] 
VNVT[43] 



1 NV T [DISPLAY HISTORY MARK I 

i y///^NVjTjn^ W/NOTrUDGED / 

zTT^^NVTfe l / ///A not 



NOT JUDGED 



NVT144] 



NOT JUDGED 



47 



fl 



« 



1 

EP 0 B27 340 A2 



FIG. 11A 



PRESENTATION CACHE UNIT 





PRESENTATION STREAM 


DISPLAY HISTORY MARK 


MOTION PICTURE/ FRAME 


1 


PRESENTATION STREAM 1 1 J 


©Hii 


MOTION PICTURE 


2 


PRESENTATION STREAM 12] 


NOT JUDGED 


MOTION PICTURE 


3 


PRESENTATION STREAM[3j 


NOT JUDGED 


MOTION PICTURE 


4 


PRESENTATION STREAM14] 


NOT JUDGED 


FRAME 


5 


PRESENTATION STREAM[5J 


NOT JUDGED 


FRAME 



FIG. 11B 



PRESENTATION CACHE UNIT 





PRESENTATION STREAM 


DISPLAY HISTORY MARK 


MOTION PICTURE/FRAME 1 


1 


PRESENTATION STREAM! 11 


©HIT • 


MOTION PICTURE 1 


2 


PRESENTATION STREAM 1 2j 


©HIT 


MOTION PICTURE I 


3 


PRESENTATION STREAM [3] 


NOT JUDGED 


MOTION PICTURE 1 


4 
5 


PRESENTATION STREAM [4] 
PRESENTATION STREAM [5] 


NOT JUDGED " 
~ NOT JUDGED 


FRAME 1 

FRAME | 



FIG. 11C 



i 



3 
4 



PRESENTATION CACHE UNIT 



PRESENTATION STREAM 



PRESENTATION STREAM [ 1 ] 



PRESENTATION STREAM (2) 



FREE AREA 
FREE AREA 



FREE AREA 



DISPLAY HISTORY MARK 



'KIT 



MOTION PICTURE/FRAME 



MOTION PICTURE 



MOTION PICTURE 



48 



EP 0 827 340 A2 



FIG ' 1 10 PRESENTATION CACHE UNIT 

i PRESENTATION STREAM 
PRESENTATION STREAM [1] 



1 



3/ 



PRESENTATION STREAM [2] 
PRESENTATION STREAM [I I j 
PRESENTATION STREAM! 12 



'/ 5 /| PRESENTATION 



1 



niSPi AY HISTORY MARK 1 MOTION PICTURE/TRAM 



NOT JUDGED' 
NOT JUDGED. 



MOTION PICTURE 



MOTION PICTU RE 
MOTION PICTI 
FRAME 



FRAME 



FIG. HE 



PRESENTATION CACHE UNIT 




-FIG. 11F 



1 



PRESENTATION CACHE UNIT 



PRESENTATION STREAM 



PRESENTATION STREAM [ 1 ] 



PRESENTATION STREAM [21 
PRESENTATION STREAM 1 14 



FREE AREA 



FREE AREA 



DISPLAY HISTORY MARK 



'HIT 



MOTION PICTURETRA! 



MOTION PICTURE 



MOTION PICTURE 



FRAME 



49 




EP 0 827 340 A2 



FIG. 11G 



PRESENTATION CACHE UNIT 





PRESENTATION STREAM 


DISPLAY HISTORY MARK. 


MOTION PICTURE/FRAME | 




PRESENTATION STREAM[411 


'/// NOT JUDGED/ 


V///////A 


2 


PRESENTATION STREAM 142] 


'///, NOT JUDGED/ 


V///////A 


3 


PRESENTATION STREAM 1 12] 


©HIT 


FRAME | 


< 4 / 


.PRESENTATION STREAM [43] 


NOT JUDGED/] 




b-iH 


•PRESENTATION STREAM 144] 







50 



J 

V 



1 



EP 0 827 340 A2 



FIG. 12 





STAuSTICS VALUE 


NVT[1] 


15 


NVT[2] 


16 


NVT(3] 


18 


NVT[4] 


4 


NVT[5] 


6 


NVT[6] 


10 


NVT[7] 


11 


NVT[8] 


12 


NVT[9] 


6 


NVTtlO] 


2 


NVT[11] 


3 


NVT[12] 


5 


NVT[13] 


6 


NVT[14] 


4 


NVT(15] 


3 


NVT[16] 


13 


NVT[17] 


15 


NVT[18] 


11 


NVT[19] 


8 



STATISTICS VAllS 



NVT[41] 

NVT(42] 

NVT[43] 

NVT[44) 

NVT[45] 

NVT[46] 

NVT[47] 

NVT[48] 

NVT[49] 

NVT[50] 

NVT[51 

NVT[52; 

NVT[53] 

NVT(54] 

NVT[55] 

NVT[561 

NVT[57] 

NVT(58] 

NVT[59] 



f 



51 



EP 0 827 340 A2 



FIG. 13A 

CACHE TABLE BASED ON STATISTICS VALUES 



content[41] 



content[42) 



content[43] 



content[44] 



content[45] 



FIG. 13B 

CACHE TABLE BASED ON RANK 




FIG. 13C 

CACHE TABLE BASED ON CURSOR POSITION 

content [41] 



cpntent[42] 



content[43] 
content[45] 



content[46] 



52 



EP 0 827 340 A2 



FIG. 14 




ROOT NUMBER^ 



S51 



I 



STORE PRESENTATION STREAM [P] AND I^S52 
NVT[P] INTO CACHE UNITS 




READ CONTENTS ONE GENERATION 
LATER THAN CONTENT [p] IN ADVANCE. 




S53 



Operation instruction 
5 waited fori 

Yes 



No 



IDENTIFY CONTENT [i] CORRESPONDING TO 
CURRENT INTERACTIVE SCREEN 



55 



S56 



IDENTIFY ICON IN FUCUS,NVT[il.NAVI[m]. 



S57 



OBTAIN LINK-TARGET CONTENTjk] SPECIFIED 
BY HYPERLINK INFORMATION OF NVT[i].NAVI[m] 



S59 



53 



it 



EP 0 B27 340 A2 



FIG. 15 



^READING CONTENTS \ 
VI N ADVANCE J 

7 



S60 



SET INITIAL VALUES : SET INDEX NUMBER] 
TO 1 ; SET CACHE END FLAG TO 0. 





GENERATE CACHE TABLE 








< — © 


OBTAIN CONTENT [q] IN CACHE TABLE I 
AT POSITION OF INDEX NUMBER. | 



S62 



r 



S63 



OBTAIN NVT(p] .VIDEO ELEMENT [p], AUDIOU S64 
ELEMENT[p]. AND PCR OF CONTENT [p] 



S65 



. JAVIGATION CACHE UNIT 
INCLUDES FREE AREA WITH ENOUGH 
CAPACITY FOR STORING N VT(p]? 



Yes 



S66 



STORE NVT[p] IN NAVIGATION CACHE UNIT 




S67 



STORE NVT[p] IN A MARKED AREA 
STORING THE OLDEST NVT IN 
N AVIGATION CACHE UNIT. 

"~ : 1 



54 



11 



EP 0 627 340 A2 



FIG. 16 

(generating cach e table ) 

V 

CACHE MANAGER OBTAINS K 
A CACHE MODE I 



S77 




REGISTER s HIGHER RANKING CONTENTS AMONG 
THOSE FROM CONTENT(NVT[p].MAVI[START]. 
LINK DESTINATION ) TO CONTENT(NVT[p].NAVI(END]. 
LINK DESTINATION) IN CACHE TABLE. 



S79 




REGISTER s HIGHER RANKING CONTENTS AMONG 
THOSE FROM CONTEKT(NVT|pl jNAVI[START|. 
LINK DESTINATION) TO CONTENT(NVT[p].NAVllEND]. 
LINK DESTINATION) IN CACHE TABLE.BASED ON 
•RANK' COLUMN IN HYPERLINK TABLE. 



S82 



CONTENT INCLUDING ICON CURRENTLY IN FOCUS 
-♦RANK1 

CONTENT INCLUDING ICON IN RIGHT OR LEFT HAND 
SIDE OF ICON IN FOCUS-RANK 2 
CONJENTINCLUDING UPPER OR LOWER ICON OF 

ffiffi IN SLANTING DIRECTION 

FROM ICON IN FOCUS-RANK 4 




END 



55 



EP 0 827 340 A2 



FIG. 17 




OBTAIN PIDS OF VIDEO ELEMENTlp] AND AUDIO 
ELEMENT(p| OF PRESENTATION STREAMfp] . 



S83 



I 



SET OBTAINED PIDS IN TS DECODER.RECEIVE 
PRESENTATION STREAM [p] . 



S84 



^S85 

presentation cache unit 
Includes free area with enough capacity for" 
storing presentation strea.\i(p|? 



No 



S95 



Yes 



STORE RECEIVED PRESENTATION 
STREAM |p] IN PRESENTATION 
CACHE UNIT. 



TRESENi ATiON CACHE UNIT INCLUDES 
FREE AREA WITH ENOUGH CAPACITY FORSTORINC 
FIRST FRAME OF F RESENTATION STREAM(p]? 



S86 



No 



INDEX - INDEX -H^ 



S92 



STORE FIRST FRAME OF 



PRESENTATION STREAM 
IN PRESENTATION CACHE 
UNIT. 



Pi 




S96 




S97 



STORE FIRST FRAME OF PRESENTATION 
STREAMfp] IN A MARKED AREA OF 
PRESENTATION CACHE UNIT STORING 
THE OLDEST PRESENTATION STREAM. 




56 



EP 0 827 340 A2 



FIG. 18 



( START ) 
ROOT NUMBER]^ 



S2 



OBTAIN NVT(i). VIDEO ELEMENT(i). 
AND AUDIO ELEMENT(i). 



•S3 



DISPLAY INTERACTIVE SCREEN GENERATED FROM THE 
OBTAINED NVT[i], VIDEO ELEMENT(i],AND AUDIO ELEMENT[i). 




MAKE BIT MAP OF NVT[i].NAVI(m] 
BE IN DETERMINATION ST ATE. 



CURSOR 
[OVE OPERATION I! 
SPECIFIED? 



No 



OBTAIN LINK-TARGET CONTENT [k] 
SPECIFIED BY NVT[i].NAVI[m]. 



S12 



'Yes 



•S8 



I 



OBTAIN NVT(k], VIDEO ELEMENTAL 
AND AUDIO ELEME NTS). 

■ 



S13 



CLEAR STATE OF 
BEING IN FOCUS 
FOR BIT MAP OF 
NVT[i].NAVI(m]. 



INCREMENT STATISTICS VALUE FOR 
N VT[kl IN THE STATISTICS TABLE BY ONE. 

i 



S14 



i — k 

r 



S15 



S16 



I 



S9 



VARIABLE m <- 
LINK-TARGET 
INDEX NUMBER 



DELETE PRESENTATION STREAMS 
AND NVTS WITHOUT MARKS FROM 
PRESENTATION CACHE UNIT AND 
NAVIGATION CACHE UNIT. 



S10 



MAKE BIT MAP OF 
NVT(i]. NAVI[m] BE 
IN FOCUS. 



S18 



CACHE END FLAG IS 1? 



No 



Yes 



57 



EP 0 827 340 A2 



FIG. 19 

SWITCHING INTERACTIVE 
SCREENS 



'RESENTATIOI 
'STREAMM IS STORED IN 
PRESENTATION 
[lACHEUNITl 



S21 



No 



S25 



Ye: 



FIRST FRAME 0? 
PRESENTATION STREAMM 
IS STORED IN PRESENTATIOl 
CACHE UNIT? 



No 



INSTRUCT CACHE 
PROCESSING UNIT 
TG READ PRESENTATION 
STREAM (il FROM 
PRESENTATION CACHE 
UNIT. 



S29 



S22 



Yes 



GRAPHIC DISPLAYING 
UNIT OUTPUTS DEFAULT 
SCREEN. 



S26 




INSTRUCT CACHE PROCESSING UNTT 

TO READ FIRST FRAME OF PRESENTATION 

STREAM[i| FROM PRESENTATION CACHE 

UNIT. 



INSTRUCT INPUT SWITCHING UNITSO THAT 
STREAMS ARE DISTRIBUTED TO AV DECODER 
FROM PRESENTATION CACHE UNIT. 



INSTRUCT AV DECODER CONTROLLING UNIT TO ISSUE 
PIDS OF VIDEO ELEMENT(i) AND AUDIO ELEMEMT[i] TO 
AV DECODER.DISPLAY FIRST FRAME OF PRESENTATION STREAMS 



,S23 



INSTRUCT INPUT SWITCHING 
UNIT SO THAT STREWS AREA r _ , 
DISTRIBUTED TO AV DECODER FROM 
PRESENTATION CACHE UNIT. 



S30 



INSTRUCT INPUT SWITCHING UNIT 
SO THAT STREAMS ARE DISTRIBUTED 
TO AV DECODER FROM TS DECODER. 



INSTRUCT AV DECODER CONTROLLING UNIT SO THAT PIDS 
OF VIDEO ELEMENTIi] AND AUDIO ELEMENT(i) ARr. SSUED 
TO AV DECODER DISPLAY PRESENTATION STREAM[i|. 



58 



EP 0 827 340 A2 



FIG. 20 



S31 

nvtwis v< > 1w no 
Stored in navigation. 

.cache unit? 



S42 



Yes 



S32 



ISSUE ICON DISPLAY INSTRUCTION 
TO GRAPHIC DISPLAYING UNIT. 



FETCH NVT(i] FROM 
NAVIGATION CACHE UNIT 



S43 



OUTPUT TABLE IDENTIFIER 
OF NVT[i] TO TS DECODER. 



INSTRUCT TS DECODER 
TO RECEIVE NVT[i] 



S44 



S45 



NVT[i] HAS BEEN 
RECEIVED?. 

Yes 



No 



TRANSFORM ALL THE BIT MAPS INCLUDED 
IN "NVT(i], NAVI_[start]"-"NVTli]. NAVI_(end] 
FOR DISPLAY. 



S46 



OUTPUT TRANSFORMED BIT MAPS TO 
AV DECODER. 



S47 



INSTRUCT AV DECODER TO COMBINE 
TRANSFORMED BIT MAPS WITH IMAGE 
GENERATED FROM PRESENTATION STREAM [i] 



S48 



K 



59 



EP 0 827 340 A2 



FIG. 21 



K 



S49 



NVTfil IS STORED IN 
NAVIGATION CACHE 
UNIT? 



Yes 



STORE NVT[i 
NAVIGATION 



IN 

CACHE 



S100 



UNIT WITH A MARK 



S101 



MARK NVT[i] IN 
NAVIGATION CACHE 
UNIT 




STORE PRESENTATION STREAM [ 
IN PRESENTATION CACHE UNIT 
WITH A MARK. 



S104 



MARK PRESENTATION 
STREAM [i] IN PRESENTATION 
CACHE UNIT. 



T 



SET CACHE END FLAG TO 0. Y 



SI 06 



m<-l 



Y 



S107 



MAKE BIT MAP OF NVT[ 
NAVI[m]BEINFOCUS. 




S108 




60 



EP 0 827 340 A2 



FIG. 22A 

IMAGE OF PRESENTATION STREAM[1] 
+ ICONS OF NVT(1] 




(EVENT hNFORMATTON^ 



RETURN 



ICON "NEW MOVIE INFORMATION"- LINKS TO CONTENT^ 
ICON "INTERNET LATEST INFORMATION LINKS TO . CONTENTS 



ICON "EVEWWFORMAflON" LINKS TO ^CONTENT 
ICON "PROGRAM PREVIEW LINKS TO CONTENT^ 



4] 



61 



EP 0 827 340 A2 



FIG. 22B 



IMAGE OF PRESENTATION STREAM [2] 
+ ICONS OF NVT12] 




ICON 'THE TERROR OF THE HUGE TORNADO; LINKS > TO ..C0NTENTU1] 
ICON "THE RETURN OF THE MONSTROUS DINOSAURS LINKS TO C0NTENT[12] 
ICON -SPORTSWARS' LINKS TO CONTENT^!) 



62 



EP 0 827 340 A2 



FIG. 22C 



IMAGE OF PRESENTATION STREAM [12] 
+ ICONS OF NVT[12] 




(OPENING ~~\ (STORM IN X STATE) 
(ENTRANCE OF THE ENTIRE CAST ) (WEATHER S ^ Ll ^- ^ / 
(WHOLETQWNIN PANIC t 

l»» l l) J 11 7 #f=->^ -M 

(weather report) y> 

(CLIMAX 




THE BIGG EST TOaNADO IN HISTORY DEVELOPS^ 



ENDING 



3 




(return) 



ICON 'OPENING* LINKS TO C0NTEMT[41] 

ICON 'STORM IN X STATE" LINKS TO CONTENTS 

ICON 'ENTRANCE OF THE ENTIRE CAST' LINKS TO CONTENT(43] 

TCON 'WEATHER SATELLITE' LINKS TO CONTENT[441 

ICON 'WHOLE TOVVN IN PANIC LINKS TO CONTENT(45] 

ICON 'WEATHER REPORT' LINKS TO CONTENT[461 

ICON 'THE BIGGEST TORNADO IN HISTORY DEVELOPS' LINKS TO 

ICON 'CLIMAX* LINKS TO . CONTENT'^] 

ICON 'ENDING* LINKS TO CONTENT^) 



CONTENT[47| 



63 



EP 0 827 340 A2 



FIG. 22D 

IMAGE OF PRESENTATION STREAM[43] 
+ICONS OF NVT[43] 




64 



EP 0 827 340 A2 




EP 0 827 340 A2 



FIG. 24A 



VET (15) PID= 0x0083 

VE id exetension= 0x0001 



first_pts 


360000 


last_pts 


360000 


stream_id 


Oxef 


component_tag 


0x0001 



FIG. 24B 



VET (16) PID =0x0083 

VE_id_exetension= 0x0000 



first_pts 




last_pts 




stream.. id 


OxeO 


component_tag 


0x0000 



EP 0 827 340 A2 




67 



